Simple dashboard for OSINT research via term query amongst web search, RSS feeds, and email.
- Clone the repository
- Install the requirements via
pip install -r requirements.txt
- Download the spacy model via
python -m spacy download en_core_web_sm
- If you wish to have web search capabilities, setup your Google Custom Search Engine and get the API key and search engine ID. Set the environment variables
GOOGLE_API_KEY
andGOOGLE_CSE_ID
respectively. They allow 100 search results per day for free, and each query pulls 10. - Run the app via
python osint_researcher.py
- Open the browser and navigate to
http://127.0.0.1:8050/
- Email feature currently is Microsoft Outlook client only. Possible more options to be added later, e.g. Gmail.
- RSS feeds are already included, but feel free to delete the JSON file, or clear it out if you don't want these feeds.
- Thinking of also adding SerpAPI for additional web search capability (they also have a free amount of usage).
![Screenshot 2024-07-20 at 11 17 52 PM](https://private-user-images.githubusercontent.com/25640614/350734936-1a87f215-bfb0-45ce-933e-c2622c33c9ad.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk2MDAxMDEsIm5iZiI6MTczOTU5OTgwMSwicGF0aCI6Ii8yNTY0MDYxNC8zNTA3MzQ5MzYtMWE4N2YyMTUtYmZiMC00NWNlLTkzM2UtYzI2MjJjMzNjOWFkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE1VDA2MTAwMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTdmNmVjOTVjMGU1MDBmMWJjNjY4ZjhhN2IzNWM4MGM3ODlmMmY0NTZmMGY5NzA5NjE3Y2MzMzJiZTY1OTZiNWMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.WmoosVDGbtooOTVkV7UsISFrWm-Nj_vKaXh_xMIxO-o)
![Screenshot 2024-07-20 at 11 18 10 PM](https://private-user-images.githubusercontent.com/25640614/350734945-d7e78a33-370e-4d2c-8f5e-bea4dbb2edb5.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk2MDAxMDEsIm5iZiI6MTczOTU5OTgwMSwicGF0aCI6Ii8yNTY0MDYxNC8zNTA3MzQ5NDUtZDdlNzhhMzMtMzcwZS00ZDJjLThmNWUtYmVhNGRiYjJlZGI1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE1VDA2MTAwMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTJlMmY3NDk3YmQ0OWY0ZTg0ZWExY2Q5ZmNiNjg1OWZkNmZjYTUwNmRhNWY2ODg5MTIzZWM4YmJlZWM5ZTI2YmImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.9OV9tykT4Ns6nB3vLvboukgwzwED6G71NielBhlA1E8)
![Screenshot 2024-07-20 at 11 18 57 PM](https://private-user-images.githubusercontent.com/25640614/350734947-bcce9272-c1f2-4b55-820f-b6ccefa24c28.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk2MDAxMDEsIm5iZiI6MTczOTU5OTgwMSwicGF0aCI6Ii8yNTY0MDYxNC8zNTA3MzQ5NDctYmNjZTkyNzItYzFmMi00YjU1LTgyMGYtYjZjY2VmYTI0YzI4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE1VDA2MTAwMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWU1MGExYjZjNDY4NjhmYjkwZjNmOTYyNmVmZTI5MmU2OTlmZmFiZDcyODI3ZmRmMWM0OWE2ZTA3MGZiYjA2MjMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.4Wj4fcuT46MBvebuhrXsNmXs5Bvj1MBMasdwH2oVa34)
![Screenshot 2024-07-20 at 11 19 07 PM](https://private-user-images.githubusercontent.com/25640614/350734949-9ab21d79-2671-416e-9e2a-c88c76ffcc29.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk2MDAxMDEsIm5iZiI6MTczOTU5OTgwMSwicGF0aCI6Ii8yNTY0MDYxNC8zNTA3MzQ5NDktOWFiMjFkNzktMjY3MS00MTZlLTllMmEtYzg4Yzc2ZmZjYzI5LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE1VDA2MTAwMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWRjYjg3MWRlM2JjMzhjYzk3NDE3NDNhZDFmOTNjZjQzZmIyOWViNTA2ZTdmYjQ1Y2Y4ZmYxOTYwOGI2YWNiN2MmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.MyE43aQ6PyaTM7VyH1YBE7PyR3FDD9-tE16A-kpCNXQ)
![Screenshot 2024-07-20 at 11 19 16 PM](https://private-user-images.githubusercontent.com/25640614/350734950-b5fd7bbf-730d-41ac-a7db-78e61f653c10.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk2MDAxMDEsIm5iZiI6MTczOTU5OTgwMSwicGF0aCI6Ii8yNTY0MDYxNC8zNTA3MzQ5NTAtYjVmZDdiYmYtNzMwZC00MWFjLWE3ZGItNzhlNjFmNjUzYzEwLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE1VDA2MTAwMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWMwYzcwOWY4YjZkMjE4ZGI5YjU3ZTVmYzA4ZGVkZGIzOTc1ZTZjODQ1YjZiZjIxOGViNTc4MGUzOWY2MzAzNTAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.G7u2qpi67pn1c9tLoSEpnxNwvWqIghUBSFDs4YlxeAI)
![Screenshot 2024-07-20 at 11 19 29 PM](https://private-user-images.githubusercontent.com/25640614/350734951-6ef48368-0a17-41f8-82f4-c5a99882cf66.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk2MDAxMDEsIm5iZiI6MTczOTU5OTgwMSwicGF0aCI6Ii8yNTY0MDYxNC8zNTA3MzQ5NTEtNmVmNDgzNjgtMGExNy00MWY4LTgyZjQtYzVhOTk4ODJjZjY2LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE1VDA2MTAwMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWE3ZmFkNzJhNThiNDlkMmM3MzM1MWI0ZThiMTdkMTExNTgyOGM3ZjgwZWQ0ZjFiOGY2ZTVlMTdlM2NjNTYxNzQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.XH0yjETrj9hWpUxLAagGn8cmIAvS2ToAr5EeARoEG04)