Heitor Gouvêa

Home Projects About


An ecosystem of crawlers for detecting: leaks, sensitive data exposure and attempts exfiltration of data


⚠️ Warning: Uranus is currently in development, you’ve been warned :) and please consider contributing!

This project is summarized in several crawlers that constitute a single ecosystem, that monitor certain channels such as: Github, Bing, Pastebin and iHaveBeenPwned? in order to perform data leak detection, exposed sensitive files and data exfiltration attempts.


Download and setup

  # Download
  $ git clone https://github.com/GouveaHeitor/uranus && cd uranus

  # Building and starting MariaDB Database
  $ docker build --rm --squash -t uranus-database ./rest-server/migrations/
  $ docker run -d -p 3306:3306 --name database -e MARIADB_ROOT_PASSWORD=mypassword uranus-database

  # Building all crawlers and workers containers
  $ docker build --rm --squash -t bing-crawler ./crawlers/bing/
  $ docker build --rm --squash -t email-notify ./workers/email-notify

  # Running all crawlers
  $ docker run -d --name bing bing-crawler
  $ docker run -d --name email-notify email-notify