Website Indexing Service
Websites, APIs, supplier portals, JS-rendered catalogs. If data is accessible, we can extract it and deliver it as a permanent Ducted feed URL, ready for any platform.
Every other feed tool starts with a question you may not be able to answer: where is your product feed? If your catalog only exists as pages on a website, a supplier portal you do not control, or a system with no export, that is usually where the process ends.
Ducted indexes the source instead. The data is extracted, tested across your full catalog, and delivered as a live Ducted feed - and from there it behaves exactly like an uploaded file or a feed URL: map it to any template, transform values, filter records, and serve permanent feed URLs.
Not just websites. Any machine-readable data source your product catalog lives in.
Category pages, product listings, paginated catalogs. Any publicly accessible website with product data.
Authenticated or public HTTP endpoints returning JSON or XML. Ideal for supplier portals, dealer management systems, and platform APIs.
Sites that load content dynamically via JavaScript. We handle headless rendering so no data is missed.
Full catalog extraction across hundreds of pages: page numbers, offset-based, cursor-based, or infinite scroll.
Category → subcategory → product hierarchies. We crawl the full tree and merge parent context into every product record.
Data that appears only after clicking tabs, expanding sections, or triggering "Load more." We automate the interactions to reach it.
Sites with aggressive bot protection may require IP or user-agent whitelisting with the site owner. We'll flag this upfront in the quote if it applies.
Fixed price, no surprises. Quote always provided before work begins.
Tell us the source URL or API, which fields you need, and your desired output format. Use the inquiry form. Takes about 2 minutes.
Within 1-2 business days we review the source, assess complexity, and send a fixed quote. No hidden costs; you accept before anything is built.
The data extraction is built, tested across the full catalog, and a sample is provided for review. Iterations included until output is correct.
Your Ducted project is populated and live. Map fields to any output format, create as many feeds as you need, and share the permanent URL.
Setup is a one-time, quote-based fee. Ongoing index maintenance is optional and priced separately below.
One-time. Simple HTML sites and clean APIs at the lower end; JS-heavy, authenticated, or multi-level sources at the higher end.Quote always sent before any work begins.
Sites get redesigned, fields move, pagination changes. An optional monthly plan keeps each indexer running and your feed fresh when they do, so a site change never quietly breaks your data. Priced per source by scale.
Every tier refreshes at least once a day, so your feed reflects the live source within 24 hours.
Your indexer runs automatically on schedule - no manual re-runs to remember.
When the source structure changes and the indexer breaks, we reconfigure it for you.
We detect problems early and let you know before they reach your feed.
Switch maintenance on or off per scraper whenever your needs change.
Billed month to month with no lock-in - cancel any time.
Send the source and the fields you need. We review it and send a fixed quote within 1-2 business days, and nothing is built until you accept it.