EN DE

company-contact-extractor

osint › company-contact-extractor

Beschreibung

Bulk business contact extraction pipeline for US states. Scans counties via Overpass API, crawls websites for emails/contact forms, finds missing websites via DNS guessing + DuckDuckGo HTML search, and outputs enriched data to a SQLite database.

Relevanz für unsere Projekte

Pipeline für die Massen-Anreicherung von US-Bundesstaaten. Scannt Landkreise, crawlt Webseiten, findet fehlende Domains via DNS + DuckDuckGo. Verifiziert auf 9 Bundesstaaten mit 19.500+ Unternehmen.

Ablauf

1🗄️ Schritt 0: US-Städte-Datenbank aufbauen (GeoNames + Census)

2🔍 Schritt 1: County-Scan via Overpass API (4 Spiegel, 3s Verzögerung)

3🌐 Schritt 2: Bestehende Websites crawlen (E-Mails, Kontaktformulare)

4🔎 Schritt 3: Fehlende Websites finden (DNS-Raten + DuckDuckGo-Suche)

5⚡ Schritt 4: Neu gefundene Domains crawlen

6🧹 Schritt 5: Rauschen entfernen (Phantom-Telefonnummern, Template-URLs)

7📊 Schritt 6: Dashboard generieren

SKILL.md Preview

# Company Contact Extractor

## When to use this

- User asks to **find contact info** for ALL businesses in a US state
- User needs a **lead list** of businesses with phone, email, website, address
- User wants to **enrich** a list of business names with contact details from their websites
- User asks to "scrape business data" from a state or region

## 🚨 CRITICAL — Pipeline Integrity Rules (User-Enforced)

These are hard rules from the user. Violating them wastes hours of work and causes rewor

← ← Zurück zur Übersicht