Skip to content

rajviahmedtamim/NewsHawk

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2,082 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🇧🇩 NewsHawk - Bangladesh News Aggregator

A customized fork of TrendRadar for Bangladesh news monitoring

License Python RSS


📖 Documentation

👉 Complete Setup Guide - Start here for step-by-step setup instructions!

📚 All Documentation - Browse all guides and references


🚀 Quick Start

# Fetch English news
python3 fetch_google_news_en.py

# Fetch Bangla news (বাংলা)
python3 fetch_google_news_bn.py

# Fetch RSS news
python3 fetch_bd_rss.py

✨ Features

  • Bilingual Support - English and Bangla news in separate folders
  • Multiple Sources - Google News RSS (free, unlimited) + Bangladesh newspapers
  • Smart Filtering - Only latest news from past 24 hours
  • Dual Format - Both TXT and JSON output
  • No API Required - Primary sources are completely free

📊 News Sources

Source Articles Language API Required
Google News (English) 330+ English No
Google News (Bangla) 289+ বাংলা No
RSS Feeds 60 Both No

Total: ~679 articles per fetch


📂 Project Structure

NewsHawk/
├── 📜 News Fetchers
│   ├── fetch_google_news_en.py    # English Google News
│   ├── fetch_google_news_bn.py    # Bangla Google News
│   └── fetch_bd_rss.py            # Bangladesh RSS feeds
│
├── 📊 Output Directories
│   ├── output_google_news_en/     # English news
│   ├── output_google_news_bn/     # Bangla news
│   └── output_bd_rss/             # RSS news
│
├── ⚙️ Configuration
│   ├── config/config.yaml         # Settings
│   └── docker/.env                # API keys
│
└── 📚 Documentation
    └── docs/                      # All documentation files

📚 Documentation

Main Documentation:

Quick Guides:

Detailed Guides:

Setup & Reference:


🔧 Installation

# Clone repository
git clone https://github.com/rajviahmedtamim/NewsHawk.git
cd NewsHawk

# Install dependencies
pip3 install feedparser

# Test
python3 fetch_google_news_en.py

💻 Usage

Fetch News

# English news (330+ articles)
python3 fetch_google_news_en.py

# Bangla news (289+ articles)
python3 fetch_google_news_bn.py

# RSS feeds (60 articles)
python3 fetch_bd_rss.py

View Results

# View latest English news
cat output_google_news_en/$(date +%Y-%m-%d)/*.txt

# View latest Bangla news
cat output_google_news_bn/$(date +%Y-%m-%d)/*.txt

# View RSS news
cat output_bd_rss/$(date +%Y-%m-%d)/*.txt

🔄 Automation

# Edit crontab
crontab -e

# Add these lines (fetch every 2 hours):
0 */2 * * * cd /path/to/NewsHawk && python3 fetch_google_news_en.py
0 */2 * * * cd /path/to/NewsHawk && python3 fetch_google_news_bn.py
0 */3 * * * cd /path/to/NewsHawk && python3 fetch_bd_rss.py

🛠️ Utilities

# Test RSS feeds
python3 test_rss_feeds.py

# Clean up old files
./cleanup.sh

📖 Learn More


🤝 Credits


📜 License

GPL-3.0 License - Same as original TrendRadar


Enjoy your Bangladesh news aggregator! 🇧🇩

About

Bangladesh news aggregator with bilingual support (English + Bangla)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors