Complete pipeline for finding, scoring, and recruiting EGC (educator-generated content) affiliates for Healthy Aminos (healthyaminolabs.com) — a research peptide e-commerce brand.

Affiliates earn 15% commission. They don't receive product — they just talk about peptides and drop their affiliate link.

# 1. Clone and install
cd affiliate-pipeline
pip install -r requirements.txt

# 2. Set up environment
cp .env.example .env
# Edit .env with your API keys

# 3. Run the entire pipeline with one command
python run_all.py

# That's it. It scrapes → deduplicates → scores → exports → previews.

python run_all.py                              # Full pipeline
python run_all.py --skip-scrape                # Re-score existing data
python run_all.py --platforms tiktok instagram  # Only specific platforms
python run_all.py --min-score 50               # Only export 50+ leads to Instantly

python scrapers/scrape_tiktok.py       # Scrape TikTok
python scrapers/scrape_instagram.py    # Scrape Instagram
python scrapers/scrape_youtube.py      # Scrape YouTube
python scrapers/deduplicate.py         # Cross-platform dedup
python scoring/score_leads.py          # Score all leads
python export_instantly.py --min-score 50  # Export to Instantly CSV
python preview_leads.py --has-email    # Preview leads with email

• Python 3.8+
• Apify account — apify.com (free tier works for small runs)
• Hunter.io account (optional) — for email enrichment via n8n
• Airtable account — airtable.com (free tier works)
• n8n (self-hosted) — n8n.io
• Instantly.ai — for cold email campaigns
• OpenClaw — for DM outreach

Copy the example env file and fill in your keys:

cp .env.example .env

Each scraper searches the same hashtag/keyword set across its platform:

peptides, bpc157, trt, hrt, biohacking, sarms, musclegrowth, antiaging, ghk-cu, thymosin, mk677, ipamorelin, bodybuilding, hormoneoptimization, testosteroneoptimization

python scrapers/scrape_tiktok.py
# Output: output/tiktok_creators.csv

Uses Apify actor: clockworks/tiktok-hashtag-scraper

python scrapers/scrape_instagram.py
# Output: output/instagram_creators.csv

Uses Apify actor: apify/instagram-hashtag-scraper

python scrapers/scrape_youtube.py
# Output: output/youtube_creators.csv

Uses Apify actor: bernardo/youtube-scraper

python scrapers/deduplicate.py
# Output: output/all_creators_deduped.csv

Fuzzy-matches creators across platforms by handle/display name (85% similarity threshold) so you don't contact the same person 3 times.

python scoring/score_leads.py
# Output: output/scored_creators.csv

Or score a specific file:

python scoring/score_leads.py output/tiktok_creators.csv

Instead of manually reformatting CSVs, use the export script:

python export_instantly.py                # All leads with email
python export_instantly.py --min-score 50 # Only 50+ scored leads
python export_instantly.py --min-score 70 # Priority leads only

This auto-generates output/instantly_export.csv with:

• Proper Instantly column format (email, first_name, last_name, custom1-3)
• Auto-detected topic_match per creator (peptides, biohacking, TRT/HRT, SARMs & growth)
• Name splitting from display names
• Topic distribution summary

Quick-check your pipeline results without opening a spreadsheet:

python preview_leads.py                    # Top 20 leads
python preview_leads.py --limit 50         # Top 50
python preview_leads.py --min-score 70     # Only priority leads
python preview_leads.py --platform tiktok  # Filter by platform
python preview_leads.py --has-email        # Only leads with email
python preview_leads.py --stats            # Just stats, no table

Shows: score distribution, platform breakdown, email coverage %, and a formatted table.

Scrape-extracted emails can be junk. Validate before sending:

python validate_emails.py                 # Standard validation
python validate_emails.py --strict        # Also remove unverifiable domains

Checks: format regex, junk domain/prefix filtering (example.com, noreply@, etc.), MX record lookup. Outputs output/validated_creators.csv with an email_status column and output/rejected_emails.csv log.

Generate personalized DMs for OpenClaw outreach:

python generate_dms.py                        # Default template, 50+ score
python generate_dms.py --template short       # Shorter DM
python generate_dms.py --template warm        # Warmer tone
python generate_dms.py --platform tiktok      # TikTok creators only
python generate_dms.py --min-score 70         # Priority leads only

3 built-in templates (default, short, warm). Auto-detects topic per creator. Outputs output/dm_messages.csv with pre-written messages and character counts.

python export_airtable.py                     # All leads
python export_airtable.py --min-score 40      # 40+ only

Maps scored CSV columns to exact Airtable schema, sets 15% commission tier, auto-marks 70+ leads as "Priority", formats dates. Output: output/airtable_import.csv.

Prevent re-contacting the same creators when you re-run the pipeline:

python blacklist.py add --handle biohacker_mike --reason contacted
python blacklist.py add --csv output/airtable_import.csv --status Contacted  # Bulk add
python blacklist.py remove --handle biohacker_mike
python blacklist.py list                           # Show all blacklisted
python blacklist.py filter --input output/scored_creators.csv  # Remove blacklisted from CSV
python blacklist.py stats                          # Breakdown by reason/platform

Persists in blacklist.csv. Checked by the export scripts automatically.

When you re-run the scrapers next week, merge new creators with existing data:

python merge_runs.py                  # Auto-merge scored_creators.csv into master
python merge_runs.py --archive        # Archive old master before overwriting

Keeps higher scores, preserves manual notes/status, deduplicates by username+platform. Outputs output/master_creators.csv.

Find emails for creators who don't have one in their bio:

python enrich_emails.py --dry-run              # Preview candidates
python enrich_emails.py --min-score 50         # Enrich 50+ leads
python enrich_emails.py --limit 100            # Cap at 100 API calls

Uses Hunter.io API. Rate-limited to 1 req/sec. Shows remaining quota.

python analytics.py                  # Full pipeline health report
python analytics.py funnel           # Conversion funnel visualization
python analytics.py sources          # Which platforms produce best leads
python analytics.py compare          # Compare current run vs. master database

Or via Makefile: make analytics, make funnel, make sources, make compare.

Edit config.yaml to change settings without touching Python:

# Add new hashtags
hashtags:
  - peptides
  - bpc157
  - newhashtag     # ← just add here

# Adjust scoring
scoring:
  max_follower_points: 30
  email_available_points: 15
  
# Change export thresholds
export:
  instantly_min_score: 50
  priority_threshold: 70

make help              # Show all commands
make run               # Full pipeline
make run-fast          # Re-score existing data (skip scraping)
make preview           # Preview top 30 leads
make analytics         # Full pipeline health report
make funnel            # Conversion funnel
make merge             # Merge new data into master
make enrich            # Email enrichment (dry run)
make blacklist-stats   # Blacklist breakdown
make clean             # Delete all output CSVs

Test your n8n workflows before going live:

python test_webhooks.py --url https://your-n8n.com --dry-run   # Preview payloads
python test_webhooks.py --url https://your-n8n.com             # Send test data
python test_webhooks.py --url https://your-n8n.com --webhook enrichment  # Test one

See templates/airtable_setup_guide.md for detailed instructions.

Quick version:

1. Create a new Airtable base called "Affiliate Pipeline"
2. Create 3 tables: Creators, Outreach Log, Performance
3. Import output/scored_creators.csv into the Creators table
4. Map the columns (see setup guide for field types)

CSV templates for each table are in the templates/ folder.

Two pre-built workflows in the workflows/ folder:

• Trigger: Webhook (POST to /lead-enrichment)
• Flow: Extract creator data → Hunter.io email lookup → If score >= 70, set status to "Priority" → Update Airtable

• Trigger: Webhook (POST to /outreach-log)
• Flow: Format data → Create Outreach Log entry → Update Creator status to "Contacted"

To import:

1. Open your n8n instance
2. Go to Workflows → Import from File
3. Select the JSON file
4. Configure the Airtable credentials (click on each Airtable node and set up your API key)
5. Set environment variables in n8n: HUNTER_API_KEY, AIRTABLE_BASE_ID
6. Activate the workflow

1. Run python export_instantly.py --min-score 50 (auto-generates output/instantly_export.csv)
2. In Instantly: Leads → Upload CSV → select output/instantly_export.csv
3. Map fields (they auto-map since column names match Instantly's format)
4. Create a campaign using the email templates from templates/email_sequence.md
5. Map merge variables: custom1 → {platform}, custom2 → {handle}, custom3 → {topic_match}
6. Set the sequence:
   • Email 1: Day 0
   • Email 2: Day 3
   • Email 3: Day 8

Use OpenClaw alongside email for DM outreach on TikTok and Instagram.

Setup:

1. Create an OpenClaw account and connect your social accounts
2. Import your scored leads (filter to lead_score >= 60)
3. Use a similar message structure to Email 1 but shorter:

Hey {handle}! Saw your content on {topic_match}. I run a research peptide company and want to give you 15% on every sale — no product needed, just your link. Interested?

4. Log DM outreach via the n8n Outreach Tracker webhook:

curl -X POST https://your-n8n.com/webhook/outreach-log \
  -H "Content-Type: application/json" \
  -d '{"creator_record_id": "rec...", "channel": "DM", "message_sent": "Initial DM"}'

• Get Apify API key
• Run all 3 scrapers
• Run deduplication
• Run lead scoring
• Set up Airtable base and import data
• Review top 50 leads manually

• Import leads into Instantly
• Set up email sequence (3 emails)
• Launch email campaign (batch of 50/day)
• Set up OpenClaw for DM outreach on top leads
• Import n8n workflows and activate

• Review responses in Airtable
• Onboard interested creators (send affiliate links)
• Set up Performance tracking table
• Run scrapers again with any new hashtags discovered
• Scale to 100+/day outreach

affiliate-pipeline/
├── .env.example          # API keys template
├── .gitignore
├── config.yaml           # No-code config (hashtags, scoring, thresholds)
├── Makefile              # 25+ quick commands
├── requirements.txt      # Python dependencies
├── README.md             # This file
├── run_all.py            # One-command full pipeline (8 steps)
├── export_instantly.py   # Auto-generate Instantly CSV with topic matching
├── export_airtable.py    # Auto-generate Airtable-ready CSV
├── generate_dms.py       # Generate DM messages for OpenClaw
├── validate_emails.py    # Email format + MX record validation
├── enrich_emails.py      # Batch Hunter.io email finding
├── merge_runs.py         # Incremental merge across pipeline runs
├── blacklist.py          # Skip already-contacted creators
├── analytics.py          # Pipeline health reports + conversion funnel
├── preview_leads.py      # CLI lead preview + stats
├── test_webhooks.py      # Test n8n webhook endpoints
├── scrapers/
│   ├── config.py         # Shared config, hashtags, Apify helpers
│   ├── scrape_tiktok.py  # TikTok creator scraper
│   ├── scrape_instagram.py # Instagram creator scraper
│   ├── scrape_youtube.py # YouTube creator scraper
│   └── deduplicate.py    # Cross-platform dedup
├── scoring/
│   └── score_leads.py    # Lead scoring (1-100)
├── templates/
│   ├── email_sequence.md # 3 cold email templates
│   ├── airtable_creators.csv
│   ├── airtable_outreach.csv
│   ├── airtable_performance.csv
│   ├── airtable_setup_guide.md
│   └── instantly_import.csv
├── workflows/
│   ├── n8n_lead_enrichment.json
│   └── n8n_outreach_tracker.json
└── output/               # Generated CSVs (gitignored)
    └── .gitkeep

Total estimated cost for first batch: ~$50-100 (scraping) + tool subscriptions