ALERT!
Click here to register with a few steps and explore all our cool stuff we have to offer!

Jump to content



Photo

Need help scraping


  • Please log in to reply
Need help scraping

#1

CheapAccounts0
CheapAccounts0
    Offline
    18
    Rep
    43
    Likes

    huh

  • PipPipPipPipPipPipPip
Posts: 1011
Threads: 48
Joined: Dec 09, 2018
Credits: 0

Five years registered
#1

Hello Nulled, i have alrdy asked around but with no luck.
I want to copy some site content, from another site, to use on my own.
Basically, i need something like HTTrack, but a tool that will scrape all 
direct url to .mp4 files. I want a website's videos, and HTTrack & chrome extensions

are the only way i discored so far. It's sadly not good enough, because i will have to do manually on every video. 

So anyone knows how to scrape all direct video urls, from one website? 


  • 1

#2

VegasGFX
VegasGFX
    Offline
    51
    Rep
    238
    Likes

    HQ GFX & Account Provider

Posts: 840
Threads: 99
Joined: Dec 01, 2018
Credits: 0

Five years registered
#2

Interested in this as well. Movie apps like terrerium and cinema HD were able to do it from certain file hosts


  • 0

The #1 NordVPN Accounts From Only $0.90 For A Limited Time

https://shoppy.gg/user/VegasGFX/

The Best Minecraft Accounts For Only $0.90 For A Limited Time

 

 


  ?url=https%3A%2F%2Fi.imgur.com%2FtERPdRP


#3

MI8
MI8
    Offline
    11
    Rep
    58
    Likes

    Addicted

Posts: 205
Threads: 62
Joined: Oct 27, 2018
Credits: 0

Five years registered
#3

...

 

What about if you go deeper with httrack by increasing the level of ripping? @CheapAccounts0


  • 0

19155562.gif

Discord: geezas#0841


#4

CheapAccounts0
CheapAccounts0
    Offline
    18
    Rep
    43
    Likes

    huh

  • PipPipPipPipPipPipPip
Posts: 1011
Threads: 48
Joined: Dec 09, 2018
Credits: 0

Five years registered
#4

What about if you go deeper with httrack by increasing the level of ripping? @CheapAccounts0

Honestly haven't tried HTTrack yet, as i know it only does the layout and the homepage only. 
Have you heard of Scrapy before? I've heard it can do it, but it requires manually coding :/ 


  • 0

#5

MI8
MI8
    Offline
    11
    Rep
    58
    Likes

    Addicted

Posts: 205
Threads: 62
Joined: Oct 27, 2018
Credits: 0

Five years registered
#5

Honestly haven't tried HTTrack yet, as i know it only does the layout and the homepage only. 
Have you heard of Scrapy before? I've heard it can do it, but it requires manually coding :/ 

 

Httrack is a very powerful tool, believe me,  you just need to play with it and with its settings. It can even grab beyond a login with the right setup. I use it on a Kali machine.

 

Never heard about Scrapy, no. @CheapAccounts0


  • 1

19155562.gif

Discord: geezas#0841


#6

FaithHF
FaithHF
    Offline
    36
    Rep
    234
    Likes

    SESH

Posts: 408
Threads: 36
Joined: Dec 04, 2016
Credits: 0

Seven years registered
#6

Yes, HTTrack will do it if you play with the settings enough. But sometimes, the video isn't loaded as a link, ie.

Please Login or Register to see this Hidden Content

In these cases, it's usually loaded through some script on the site that uses a canvas or something and again, not easy to grab. HTTrack likely won't be able to pull this. You need to pull the source from the script. Luckily, the scripts are usually all the same on each page or for each video, just a different source file being referenced.

 

Scrapy will be able to do it, obviously, but you'll need to use your brain, since it's just a Python library, not a standard tool or something.


  • 1

#7

blackblock
blackblock
    Offline
    0
    Rep
    5
    Likes

    Member

  • PipPipPip
Posts: 31
Threads: 5
Joined: Feb 01, 2019
Credits: 0

Five years registered
#7

i second scrapy its very good. if you use scrapy + beautifulsoup + mechanize + selenium you can scrape absolutly anything you want but it requires a lot of work. there are some good tutorials though like here:

Please Login or Register to see this Hidden Content


  • 0

#8

uwuhook666
uwuhook666
    Offline
    0
    Rep
    -3
    Likes

    New Member

  • PipPip
Posts: 14
Threads: 0
Joined: Feb 01, 2019
Credits: 0
Five years registered
#8

zxfzxgzdgxcgfg


  • -1

#9

CheapAccounts0
CheapAccounts0
    Offline
    18
    Rep
    43
    Likes

    huh

  • PipPipPipPipPipPipPip
Posts: 1011
Threads: 48
Joined: Dec 09, 2018
Credits: 0

Five years registered
#9

zxfzxgzdgxcgfg

Reported


  • 0


 Users browsing this thread: