Advanced Open-Source Intelligence Gathering Platform
Automate digital footprint discovery, source classification, and intelligence visualization — all from a single search query.
- Overview
- Features
- Tech Stack
- Prerequisites
- Installation
- Usage
- Project Structure
- How It Works
- Makefile Commands
- Disclaimer
- License
OSINT Analyzer Ultimate is a web-based intelligence-gathering platform that automates the collection, classification, and visualization of publicly available information. Given any search query — a name, company, domain, or keyword — the tool uses a headless browser to extract results from DuckDuckGo, classifies each source by type, and renders an interactive node graph mapping the digital footprint.
Built for cybersecurity researchers, journalists, and digital investigators who need structured intelligence fast.
| Feature | Description |
|---|---|
| 🔎 Headless Scraping | Uses Playwright to simulate a real browser and bypass bot detection |
| 🧹 URL Cleaning | Unwraps all DuckDuckGo redirect formats and validates URLs |
| 🏷️ Auto Classification | Categorizes sources — social media, news, government, educational, and more |
| 🕸️ Graph Visualization | Interactive node map built with vis-network showing source relationships |
| 🖼️ Live Favicons | Displays each website's real favicon using Google's favicon service |
| 📋 One-Click Actions | Visit or copy any URL directly from the results panel |
| ⚡ Asset Blocking | Blocks images, fonts, and stylesheets during scraping for maximum speed |
Backend
- Python 3.8+ — core language
- Flask — lightweight web framework
- Playwright — headless browser automation
Frontend
- vis-network — interactive graph visualization
- Bootstrap 5 — responsive UI framework
- Font Awesome 6 — iconography
- Vanilla JavaScript — zero frontend framework overhead
- Python 3.8 or higher
- pip (Python package manager)
- Git
- Windows / Linux / macOS
git clone https://github.com/aymane2004-2004/osint-tool.git
cd osint-toolmake installOr manually:
pip install -r requirements.txt
playwright install chromiummake runThen open your browser at:
http://127.0.0.1:5000
- Enter any search query in the terminal-style input field (name, company, domain, keyword, etc.)
- Select the analysis depth (Basic / Standard / Deep)
- Click EXEC and wait for the intelligence extraction to complete
- Explore results in the interactive graph or the URL log panel
- Use VISIT to open a source or COPY to copy its URL
osint-analyzer-ultimate/
│
├── app.py # Flask backend — scraping, cleaning, classification
├── requirements.txt # Python dependencies
├── Makefile # Build and run commands
│
└── templates/
└── index.html # Frontend — graph, results panel, UI
User Query
│
▼
Playwright (headless Chromium)
│ → navigates DuckDuckGo
│ → waits for result selectors
│ → blocks images/fonts for speed
│
▼
URL Extraction & Cleaning
│ → unwraps DDG redirect URLs (/l/?uddg=...)
│ → validates and deduplicates
│
▼
Source Classification
│ → social media, news, government, educational...
│ → based on domain pattern matching
│
▼
JSON Response to Frontend
│
▼
vis-network Graph + Results Panel
│ → nodes colored by source type
│ → favicons loaded per domain
│ → clickable nodes open URLs
| Command | Description |
|---|---|
make run |
Start the OSINT Toolkit |
make install |
Install all dependencies |
make clean |
Remove cache files (__pycache__, .pyc) |
make update |
Regenerate requirements.txt from current environment |
make dev |
Run in Flask development mode with debug enabled |
make start |
Install dependencies then start the app |
make fresh |
Clean cache then start the app |
make help |
Display all available commands |
This tool is intended strictly for educational purposes and authorized security research. It only collects publicly available information indexed by search engines. The user is solely responsible for ensuring their use of this tool complies with applicable laws and the terms of service of any platform queried.
Do not use this tool to:
- Target individuals without their consent
- Violate any platform's terms of service
- Engage in any illegal surveillance or harassment
This project is licensed under the MIT License — see the LICENSE file for details.
Built with ❤️ for the cybersecurity community
⭐ Star this repo if you find it useful!