PDA

View Full Version : Web Based Mulve Prototype



costi
09-21-2010, 10:51 PM
yes, the mulve functionality on the browser: http://fetchsong.com/

currently the crawler (> 200 lines python) is on my netbook.
but i am in contact with the mulve developers so maybe there will be a "official" version.
i`ll see for how long i can keep it up...
if it stop working i`ll fallback to the yahoo search method: http://filesharingtalk.com/threads/424026-hyper-hyper.appspot.com-yahoo-meta-search-engine-for-mp3s.-suggestions/page2
...and maybe try to find some hosting with multiple ips or something like that
lets see what happens....


enjoy it :)


this isnt my work, its just one more piece of puzzle in the infinity:
thank you linux, wine, mulve, python, ?, and much more.



ps:
does someone wants to write an articel? my english isn`t that good

anon
09-21-2010, 10:58 PM
Nice, but none of the vkontakte.ru links seem to work. I get 404s on all of them.

costi
09-21-2010, 11:01 PM
really?
thats strange never got a 404
mulve makes a HEAD on every link, but i dont want to do this server side

EDIT:
can you post a link? maybe its a location thing?

anon
09-21-2010, 11:04 PM
really?
thats strange never got a 404

Yes - Mulve works, but trying to download the exact same file with Opera throws a 404. I'd think they're checking the HTTP headers to precisely prevent apps like yours from working (have you observed Mulve uses a random User-Agent for every request?), but if it works for you... :unsure:


EDIT:
can you post a link? maybe its a location thing?

http://cs1277.vkontakte.ru/u295260/audio/30480bc7b224.mp3

costi
09-21-2010, 11:08 PM
FUCK FUCK FUCK
its a ip thing only the ip that made the search request can access the song!!!
2 days work gone

yes, i am using that random user-agent

for me its working perfectly...
but not for others...

FUCK FUCK FUCK
FUCK FUCK FUCK
FUCK FUCK FUCK

anon
09-21-2010, 11:09 PM
Too bad. :(

costi
09-21-2010, 11:11 PM
Epic Fail (-:

does anyone have a vps with unlimited traffic that he doesnt need :cry:
it would be possible if the server downloads the mp3 and then streams it to the client...

ok, now every song is proxied by my poor internet connection.
can anyne tell me if it works?


and theoretical, what if someone downloads a song and its copyright lisense doesnt alow it - can i be sued?
i am running a meta search engine and a cgi proxy server. that must be legal

anon
09-22-2010, 08:37 PM
ok, now every song is proxied by my poor internet connection.
can anyne tell me if it works?

Currently, I get an HTTP 500 error when trying to search a song.


and theoretical, what if someone downloads a song and its copyright lisense doesnt alow it - can i be sued?

I guess that depends on the laws of your country...

costi
09-22-2010, 09:37 PM
when getting 500 just reload and it should work.
i just ordered a vps and am working on a production ready version. so stay tuned (-:

anon
09-22-2010, 09:57 PM
Right, it works now. :)

If you can get the VPS and all working, I'll see if I can at least try to write a good article for the FST frontpage. :D

costi
09-23-2010, 12:20 AM
great :happy:

i am improving the scripts and waiting for the vps...


cheers,
costi

EDIT:
fetchsong.com is currently not working.

costi
09-25-2010, 01:53 AM
ok, everything is set up on my vps.

http://fetchsong.com/

i still dont really like the design, but anyway it finds almost everything with good download speeds.
with the time i will implement a web player, show file sizes and bitrates, have a google-like search suggestions, infos about the artists and some other things.
and sooner or later i will have to limit the download rate

if you want, you can write the article....
you could tell that it works exactly like mulve but without any software.

anon
09-25-2010, 04:42 PM
I like the design myself. It may not be "wow, look at that", but it's easy in my eyes and doesn't make the page hard to use. :)

As for the article, as I told you, I'm not very good at this, but here's a draft. :happy:

A lot of you must have probably heard about Mulve, a new piece of software that's already gaining popularity (and some controversy) due to its ability to download single music tracks at very high speeds from VKontakte.ru's server pool, without requiring users to upload anything else than an HTTP request.

Recently, costi, an FST (FileSharing Talk) user, has designed a Web application that enables people to get those music tracks without running the aforementioned software. All that's needed is going to FetchSong.com, typing the track's name, and clicking on "Search". Thanks to AJAX, the result list will immediately appear below the search field. Clicking any of them initiates the download.

It is noteworthy that the Mulve servers only allow downloading from the same IP address that initiated the search request, so proxying both through a VPS (Virtual Private Server) proved itself essential for FetchSong to work. However, that also provides some degree of anonymity as a side effect, since your real IP won't be seen by VKontakte.

You may access this service here:
http://fetchsong.com/

costi
09-25-2010, 06:58 PM
thank you that is great!

i would just change


However, that also provides some degree of anonymity as a side effect, since your real IP won't be seen by VKontakte.

to something like


However, that also provides some degree of anonymity as a side effect, since your real IP won't be seen by VKontakte and FetchSong.com does not keep any logs.


can you submit it?

thank you again!

Cheers,
Costi

anon
09-25-2010, 07:02 PM
Sure, will change that and submit it now. :)

costi
09-26-2010, 05:27 PM
lookg great!

unfortanly vkontakt blacklisted the ip of my server )-:
that was a lot faster that i thougt it would be.
but i tam already working on a fix:
i`ll use tor as a proxy.

sorry for the down time

anon
09-26-2010, 05:30 PM
but i tam already working on a fix:
i`ll use tor as a proxy.

As a proxy to transfer the tracks? I wouldn't advice that.

costi
09-26-2010, 07:17 PM
why not?

i know its really not elegant but the only solution i can find.
(i`ll also set up a tor relay on the vps to "give back" the bandwidth)

anon
09-26-2010, 07:21 PM
why not?

Tor was meant for people whose Internet connections are surveilled or censored to break free of those restraints and enjoy free surfing/posting/chatting, not for the transfer of (proportionally) huge music tracks.

Also, it's very easy to detect if an specific IP is a Tor exit node or not, so VKontakte could quickly and easily render your service unusable once again if they wanted to.

costi
09-26-2010, 07:38 PM
ok, its working again - using tor, its slower but still ok.

yeah, i guess it will be a neverending rearmament.
and tor is the solution for right now.

no worries, i have unlimited traffic on the vps and will set up a tor relay.
there are people how just use p2p via tor...

how can they now its a tor node?
they wont scan every ip connected for tor services?
or is there any list with all tor nodes?

the usabillity and response time will be improved in the future...
sometimes you get a error when you make a search, tor changes the exit node, you try to download a song. if this happens make the same search again. but i am fixing it...

anon
09-26-2010, 09:53 PM
how can they now its a tor node?
they wont scan every ip connected for tor services?
or is there any list with all tor nodes?

Using a service such as this:
https://check.torproject.org/

Performing a reverse DNS lookup on IPs can also give interesting results.

Camaleon
09-26-2010, 11:38 PM
The site really works

I found also rare music tracks

Great useful site!

esco123
09-27-2010, 10:15 AM
im sure this site is old, im sure i have been using this for a while, lol, maybe not then if it was only created recently. this site is very good though, that's when its up and running fine, lately is has been down quite a bit, which is annoying. i prefer this to mulve as you can browse this any where on anything with an internet connection. i like the look of the website, is very simple and easy to use and all does not attract any attention. i would maybe ant time length of song and bit-rate. Great Work. Keep this site anonymous and it will sure be a great site if its longevity is alive!!! i like the fact that is does appear in google search that way it'll last longer, maybe build a fake page to hide its true identity keeping unwanted people out would help.

anon
09-27-2010, 06:34 PM
maybe build a fake page to hide its true identity keeping unwanted people out would help.

Not much when there's a forum thread and article about it on FST, I think. :unsure:

costi
09-27-2010, 11:24 PM
i am happy about the good feedback.
with the last update everything finnally, works fine again... until vkontakt strikes back again.

does any1 nows if its possible and how to make cross site http requests with flash, sylverlight, or a java applet?

heiska
09-28-2010, 11:08 AM
i am happy about the good feedback.
with the last update everything finnally, works fine again... until vkontakt strikes back again.

does any1 nows if its possible and how to make cross site http requests with flash, sylverlight, or a java applet?

Let's see.
<cross-domain-policy>
<site-control permitted-cross-domain-policies="master-only"/>
<allow-http-request-headers-from domain="vk.com" headers="*"/>
<allow-http-request-headers-from domain="vkontakte.ru" headers="*"/>
<allow-http-request-headers-from domain="vkadre.ru" headers="*"/>
<allow-http-request-headers-from domain="*.vkadre.ru" headers="*"/>
<allow-access-from domain="vk.com" to-ports="80"/>
<allow-access-from domain="vkontakte.ru" to-ports="80"/>
<allow-access-from domain="vkadre.ru" to-ports="80"/>
<allow-access-from domain="*.vkadre.ru" to-ports="80"/>
</cross-domain-policy>
So flash is out of the question, so is unsigned java applets.

AFAIK, the only way to do it is via a signed java applet.

esco123
09-28-2010, 12:06 PM
The site does not work still, when i enter a word and press search its states unknown error : check your internet connection.

costi
09-28-2010, 02:38 PM
@heiska:
thx

now everythink should work well.
the most problems exist because of tor.
the error from esco123 probally happens from restarting the server side application - does it work now?

esco123
09-29-2010, 09:37 AM
Sorry, but it still does not work for me. It just stays at the page with the man being controlled by the mouse pointer.

Update: Site seems to work now, although a bit slow, but i dont mind. :P

esco123
10-06-2010, 08:24 PM
the sites down for a while...

Stabber
10-06-2010, 08:53 PM
Isn't mulve being shut down by RIA ?

esco123
10-08-2010, 08:29 AM
thats just the application. so if another app came along did the same job of tracking music then the cycle just repeats....

anon
10-08-2010, 03:23 PM
Pymaxe is another app like Mulve. I don't know if it still works nor where it gets the files from, but if you liked Mulve's simplicity you may want to give it a try.

mR.d@hLa!
10-08-2010, 05:02 PM
I am really looking forward to Mulve, so far I´ve been using this script for years already.

javascript:Qr=document.getSelection();if(!Qr){void(Qr=prompt('Free%20File%20Hoster%20Search',''))};if(Qr)location.href='http://www.google.com/search?num=100&hl=en&lr=&safe=off&as_qdr=all&q=+'+escape(Qr)+'+%28rapidshare.+%7C+megaupload.+%7C+sexuploader.+%7C+mytempdir.+%7C+slil.+%7C+sendspace.+%7C+turboupload.+%7C+speedshare.+%7C+hyperupload.+%7C+getfile.+%7C+depositfiles.+%7C+webfile.+%7C+file2share.+%7C+rapidupload.+%7C+yourfile.+%7C+yourfilehost.%7C+filehd.+%7C+mooload.+%7C+scambia.+%7C+filepost.+%7C+justupit.+%7C+simpleupload.%29&btnG=Search'

Just save it as favourite and run it. Worked quite well for me, though not nearly as sophisticated as Mulve is going to be. You might use it as long as Mulve is not working 100% properly.

Best regards

esco123
11-28-2010, 09:20 PM
Looks like this site is dead for good. :(

anon
11-28-2010, 09:35 PM
So is the "official" Mulve, but feel free to use The Pirate App.