عکس aliir74
Iranian Ad Sites Crawler (Divar, ...)Python
موضوع‌ها
۲
فورک‌ها
۰
ستاره‌ها
۵
تاریخ ایجاد
۲۵ خرداد ۱۴۰۱
آخرین بروزرسانی
حدود ۲ ماه قبل

Ad Sites Crawler

This is a site crawler written based on crawling the iranian ad sites. For now, it only supports Divar.

Run

  • Install docker and docker-compose.
  • Run sysctl vm.overcommit_memory=1 or set vm.overcommit_memory=1 in /etc/sysctl.conf on your host and reboot your system.
  • Copy .env.sample file to .env and change the values as you want.
  • Run docker-compose up --build.

Note

  • You should create a IFTTT webhook (3 value option) and set your account information on .env to get a notification when the crawler finds a new/changed ad.