Skip to content

Scraping DeviantArt Website for General Purposes Analytics and Time-Series Graph Generation and Analysis. :3

License

Notifications You must be signed in to change notification settings

Druidpeter/DaScrapy

Repository files navigation

DAScrape

DAScrape is a small(-ish) data analytics project I entered into at about May(-ish) of the year 2021. It basically scrapes urls and other data off of the DeviantArt website (only publicly available data, mind you. =_=) and stuffs said data into a mysql database.

I then use that database and other python scripts to process and refine the data into JSON ingest batches for druid.io clusters, which I then use to create pretty sparkly analytics time-series graphs for me and interested parties.

Neat, eh? :3

About

Scraping DeviantArt Website for General Purposes Analytics and Time-Series Graph Generation and Analysis. :3

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages