![]() If Valve changes the layout of the Steam Workshop pages, this may stop working and I may not care.If you have any bugs to report, also see "Fitness for use and Support" below.See the section on "Fitness for use and Support" below for details. If you think any of the HTML bits are ugly, I really don't care.Even trying is a bit troublesome and something you probably shouldn't trust people doing. There's no way to automate the re-running of the code on each page.It strictly deals with the data you see on the page. This code all runs locally and does not contact anything on the the internet. If not, I add the download links to the page.Įven though it says "download", there' no network activity going on other than loading your steam pages. If there are more, I scrape the data, toss it in localStorage, and load the next page. From that data, I see where we are in the pagination of items. Since there's no big data source, I have to comb the rendered DOM (HTML) elements for data along with the url. This is your most basic JS screen scraper. I took time to make it the code was (hackily) page aware and knows when to stop auto-navigating. Keep watching until the last (14th) page is scraped to see the links for saving the files get inserted. Here's a GIF of me exporting my Cities: Skylines subscriptions. You can rescrape pages or regenerate the download links if you've scraped things already. If you screw up, it'll keep the data until you close your borwser. Currently there's very basic HTML, CSV, JSON, and Plain Text. Click the link for what you want the data formatted as.Continue the above two steps until you see a box appear in the upper left hand side of the page with download links for your data. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |