Extensions :  K-Meleon Web Browser Forum
All about K-Meleon extensions. 
Pages: 12Next
Current Page: 1 of 2
Harvesting
Posted by: panzer
Date: May 21, 2010 08:36AM

Sometimes I have a lot of tabs open and I need all URL addresses. Can a macro be made to harvest all open tabs URLs and paste them in a text file, so I do not have to copy all addresses one by one (by hand)?

Options: ReplyQuote
Re: Harvesting
Posted by: mhf
Date: May 21, 2010 12:02PM

I'd really like to have this too but with the IP as well, in this format :

216.34.181.96 kmeleon.sourceforge.net

and each address on its own line so that I can easily add often used addresses (i.e. open tabs) to my Hosts file...

Options: ReplyQuote
Re: Harvesting
Posted by: siria
Date: May 21, 2010 12:17PM

Oh my.... Don't know about the IP adresses, for me that would definitely be WAY too high. But just collecting a list of open URLs into the clipboard would be quite simple, if you like also with titles, and/or with a fix text before or after. And you could paste that into any editor then - except MS notepad, because that ancient thing still doesn't understand the linebreaks *grmpf*
That said, I guess there exist already various macros for such stuff, with groups etc. ...

Options: ReplyQuote
Re: Harvesting
Posted by: desga2
Date: May 21, 2010 12:56PM

Quote
siria
Oh my.... Don't know about the IP adresses, for me that would definitely be WAY too high. But just collecting a list of open URLs into the clipboard would be quite simple, if you like also with titles, and/or with a fix text before or after. And you could paste that into any editor then - except MS notepad, because that ancient thing still doesn't understand the linebreaks *grmpf*
That said, I guess there exist already various macros for such stuff, with groups etc. ...

In MS notepad is showed all in same line because KM use one character to end of line "/n" (Unix format) instead of two characters "/n/cr" (Windows/DOS format).
This due to an old bug in macro plugin that avoid to KM can to use "/cr" character to end of lines.

@ panzer:
As siria said you can use Groups2 macro, in his new version you can export groups to an ini file, look in Development forum.
Or you can create a macro to copy all URLs of opened tabs in clipboard and paste it in your favorite text editor.

K-Meleon in Spanish



Edited 2 time(s). Last edit at 05/21/2010 12:58PM by desga2.

Options: ReplyQuote
Re: Harvesting
Posted by: disrupted
Date: May 21, 2010 01:24PM

try this:
http://kmext.sourceforge.net/tests/turlharvest.7z

to access, tab context>harvest urls>save tabs url
option to open the txt file after saving(toggle display url file) defaultyawning smileypen after save


the file will be saved in kmeleon save dir or mydocs if no save dir set(new profile)

Options: ReplyQuote
Re: Harvesting
Posted by: panzer
Date: May 21, 2010 06:04PM

Thanx.

Options: ReplyQuote
Re: Harvesting
Posted by: disrupted
Date: May 21, 2010 07:22PM

you welcome panz

download new version, it works much better using internal macro id_tab_nex instead of making autit get the urls, much faster and similar to groups macro; you won't notice any tab switching
http://kmext.sourceforge.net/files/turlharvest.7z

this also adds opion to fetch the ips and save them along the line for mhf and an option to edit in notepad


autoit src
; AutoIt Version: 3.3.0
; Language: English
; Platform: Win9x/NT
; Author: kargas

#NoTrayIcon
#Include <Misc.au3>
#include <file.au3>
#Include <String.au3>
#include <Array.au3>

If _Singleton("urlharvester", 0)=0 Then
Exit
EndIf

if $cmdline[0]<>4 then
exit
endif

$kmbin=(StringTrimRight(@scriptdir, 5) & "k-meleon.exe")
$harvfile=("urlharv.txt")

if $cmdline[1]=("") or FileExists($cmdline[1])=0 then
$savepath=(@MyDocumentsDir & "\" & $harvfile)
filedelete($savepath)
else
$savepath=($cmdline[1] & $harvfile)
filedelete($savepath)
endif


if $cmdline[4]=1 then
_FileCreate($savepath)
harvurlips()
else
_FileCreate($savepath)
harvurls()
endif

func harvurls()
$tabnumber=$cmdline[2]
$pendurls=ClipGet ( )
$remlast1=StringInStr ($pendurls, "|" , 0, -1)
$remlast2=StringMid($pendurls, 1, $remlast1-1)
$array = StringSplit($remlast2, '|', 1)
For $x = 1 to $array[0]
_FileWriteToLine($savepath, $x, $array[$x], 1)
Next
extraopt()
endfunc

func harvurlips()
TCPStartup()
$tabnumber=$cmdline[2]
$pendurls=ClipGet ( )
$remlast1=StringInStr ($pendurls, "|" , 0, -1)
$remlast2=StringMid($pendurls, 1, $remlast1-1)
$array = StringSplit($remlast2, '|', 1)
For $x = 1 to $array[0]
$prop1=StringReplace($array[$x], "http://";, "")
$prop2=StringReplace($prop1, "https://";, "")
$prop3=StringReplace($prop2, "ftp://";, "")
$prop4=StringReplace($prop3, "gopher://", "")
$prop5=StringReplace($prop4, "/", ")", 1)
$pos=StringInStr($prop5, ")")
$ddf=StringMid ($prop5, 1 , $pos-1)
if StringInStr( $array[$x], "resource:///")>0 or StringInStr( $array[$x], "file:///")>0 or StringInStr( $array[$x], "about:")>0 or StringInStr( $array[$x], "chrome://")>0 then
$writeip=("127.0.0.1")
else
$writeip=TCPNameToIP($ddf)
endif
_FileWriteToLine($savepath, $x, $writeip & " " & $array[$x], 1)
Next
extraopt()
endfunc

func extraopt()
if $cmdline[3]=1 then
$openharv=($kmbin & " " & FileGetShortName($savepath))
run($openharv)
exit
else
exit
endif
endfunc


Options: ReplyQuote
Re: Harvesting
Posted by: mhf
Date: May 21, 2010 09:51PM

Many THANKS disrupted - that's perfect !

Options: ReplyQuote
Re: Harvesting
Posted by: disrupted
Date: May 22, 2010 04:59PM

i find it very useful too especially with ips.
km users have great ideas compared to other browsers

this one claims to be the world's first, i'dn't argue that
https://chrome.google.com/extensions/detail/ijhienfmppoadiolhmeelfhbpeipmgcd

but wait, there's more
https://chrome.google.com/extensions/detail/obkgebcdmblonkhllbiooplfbknbmkke

Options: ReplyQuote
Re: Harvesting
Posted by: mhf
Date: May 23, 2010 09:34AM

Disrupted : I was wondering about a refinement - to add a menu item in the tab context menu for Harvest URL where you can harvest the URL and optionally (!!!) the IP of just the one tab that you're on at the time... ? tongue sticking out smiley

Options: ReplyQuote
Re: Harvesting
Posted by: disrupted
Date: May 23, 2010 03:14PM

you're pushing your luck mhf grinning smiley just joshing

updated to harvest current tab only, now 2 entries>harvest current, harvest all tabs

please download from same link at above post

Options: ReplyQuote
Re: Harvesting
Posted by: mhf
Date: May 24, 2010 09:24AM

No soup at all, ever ! Not even cold soup.

I just tried the new version and there are only two menu entries :

Save Tabs URL
Display URL file

Could you check please disrupted... but thanks too for your work...



Edited 1 time(s). Last edit at 05/24/2010 03:36PM by mhf.

Options: ReplyQuote
Re: Harvesting
Posted by: disrupted
Date: May 24, 2010 07:03PM

i'm pretty sure, you might be downloading from cache the old file, try clearing cache and download from this link:
http://kmext.sourceforge.net/files/turlharvest.7z

or download from mirror, mirror should definitely download the latest
http://www.mirrorservice.org/sites/download.sourceforge.net/pub/sourceforge/k/project/km/kmext/turlharvest.7z


here's another extension you might like, maybe as a supplement to urlharvest but i preferred that it should be separate from urlharvest

mapdomain, automatically gets the domain ip and adds it to your hosts file
right-click on a page and select map domain.
by default there's a confirmation message first

clicking yes, will auto add the current site domain with its ip to hosts

if you want to remove the confirmation:
go to edit>configuration>alert mapdomain (uncheck)


after mapdomain has been added, a message will display in the status bar


map domain is alvaliable in 2 versions for 9x and for nt
for 9x(98, 94, me):http://kmext.sourceforge.net/files/mapdomain9x.7z
for nt(xp,net,200,7): http://kmext.sourceforge.net/files/mapdomainNT.7z

due to the nature of this extension, 'manage hosts' extension is bundled with it which opens hosts in notepad(tools>netowrk tools>manage hosts) if you already have manage hosts installed, it will not affect your settings.

very important
please note: mapdomain is intended for advanced users only(mhf, panzer etcgrinning smiley), please use with utmost caution if you're not sure how mapping domains work as it will prevent any dnsing for the mapped domain. this makes the browser(any browser) stop querying dns servers and resolve the address immediately.. if after mapping you can't access the site( or find yourself on a completey different website), make sure to remove the entry from hosts and restart

Options: ReplyQuote
Re: Harvesting
Posted by: panzer
Date: May 25, 2010 07:54AM

Panzer? Advanced user? grinning smiley



Edited 1 time(s). Last edit at 05/25/2010 07:55AM by panzer.

Options: ReplyQuote
Re: Harvesting
Posted by: mhf
Date: May 25, 2010 10:42AM

mhf = advanced soup cook...

But thanks a million disrupted.

PS yes - the cache.

Options: ReplyQuote
Re: Harvesting
Posted by: disrupted
Date: May 25, 2010 06:11PM

Quote
panzer
Panzer? Advanced user? grinning smiley

who started tthis thread and requests advanced extensions smiling smiley

mhf, i think map domain is particulary useful with online stores and banking or anything with money involved because this makes the system(not just the browser) immune to any dns poisoning. with domain mapping, you no longer have to worry about phishing, scams and all the vulnerabilities of name servers as it ensures only the intended site will be opened directly . it's the ultimate security extension for money transactions

Options: ReplyQuote
Re: Harvesting
Posted by: mhf
Date: May 25, 2010 06:42PM

Exactly !!!

I use a local DNS server with local cache for this very reason.

As the man said "there's no place like 127.0.0.1".

Options: ReplyQuote
Re: Harvesting
Posted by: panzer
Date: May 28, 2010 08:37AM

Quote
disrupted
Quote
panzer
Panzer? Advanced user? grinning smiley

who started this thread and requests advanced extensions smiling smiley

I wonder how nobody thought to request this macro ages ago ...:O

Options: ReplyQuote
Re: Harvesting
Posted by: disrupted
Date: May 28, 2010 08:19PM

depends on needs i guess and how a browser is used. translators probably have some peculiar needs from others

Options: ReplyQuote
Re: Harvesting
Posted by: mhf
Date: May 28, 2010 09:12PM

Quote
disrupted
translators probably have some peculiar needs from others

Sorry disrupted but I don't get that - maybe needs translation ?

Options: ReplyQuote
Re: Harvesting
Posted by: disrupted
Date: May 28, 2010 09:37PM

panz is a translator. sometimes translators require special extensions that may not appear very useful to non-translators

Options: ReplyQuote
Re: Harvesting
Posted by: panzer
Date: May 29, 2010 06:43AM

I am not a translator, actually. I worked for a newspaper.

But this macro I need for "my topic" in off topic. grinning smiley



Edited 1 time(s). Last edit at 05/29/2010 07:36AM by panzer.

Options: ReplyQuote
Re: Harvesting
Posted by: panzer
Date: June 08, 2010 05:41PM

What about harvesting all links on web page (links as thumbnails leading to another page)? Can this be done? Sometimes, I just need links and do not want click on all of thumbnails and then copy all of URLs.

Options: ReplyQuote
Re: Harvesting
Posted by: disrupted
Date: June 09, 2010 06:38PM

there's a biltin option in kmeleon to display all links in a page 9view>links or page context>page properties>links. however the links will be displayed as hyperlinks with their original text- not the actual url. you probably need them as text only and not hyper? but think it can suffice cause will need to do some digging cause requires js, i'll look into it.. hopefully i canfind a ready-made js and inject in macro (coding js is a potential mental health risk D)

Options: ReplyQuote
Re: Harvesting
Posted by: siria
Date: June 09, 2010 07:35PM

I've recently seem some stuff in the wiki macro library that sounded similar...

Options: ReplyQuote
Re: Harvesting
Posted by: panzer
Date: July 01, 2010 07:56AM

I do not want to open another thread:

Can somebody write down simple default macro for opening .exe file ( progs which only have one file -.exe file) with Km? Do I need to make .ini file as well?

I tried to adjust macros I have in Km but just ended with crashing or rapid shuts down of KM. grinning smiley



Edited 1 time(s). Last edit at 07/01/2010 07:58AM by panzer.

Options: ReplyQuote
Simple macro to open exe tools from K-Meleon
Posted by: desga2
Date: July 02, 2010 08:35PM

Quote
panzer
I do not want to open another thread:

Can somebody write down simple default macro for opening .exe file ( progs which only have one file -.exe file) with Km? Do I need to make .ini file as well?

I tried to adjust macros I have in Km but just ended with crashing or rapid shuts down of KM. grinning smiley

K-Meleon macro examples to open exe tools from K-Meleon:

Level 1 => http://kmeleon.sourceforge.net/wiki/ClipTex2
Level 2 => http://kmeleon.sourceforge.net/wiki/DEP
Level 3 => http://kmeleonbrowser.org/forum/read.php?9,100997

K-Meleon in Spanish

Options: ReplyQuote
Re: Simple macro to open exe tools from K-Meleon
Posted by: disrupted
Date: July 03, 2010 10:21PM

alexapps provides easy way to launch externals without parameters, parameters can be easily added if needed
http://kmext.sourceforge.net/tests/alexapplauncher.7z

http://kmeleonbrowser.org/forum/read.php?9,103318,103362

Options: ReplyQuote
Re: Simple macro to open exe tools from K-Meleon
Posted by: panzer
Date: July 05, 2010 07:10AM

Thanx.

Options: ReplyQuote
Re: Simple macro to open exe tools from K-Meleon
Posted by: panzer
Date: July 06, 2010 07:14AM

Disrupted, how can I use alexapps on different computers where path to .exe (which are located on my UScool smiley is changing due to different drive letters?

Basically, I want alexapps portable version.



Edited 2 time(s). Last edit at 07/06/2010 07:34AM by panzer.

Options: ReplyQuote
Pages: 12Next
Current Page: 1 of 2


K-Meleon forum is powered by Phorum.