Context
Google News feeds expose wrapped article links. Data collection systems often need the actual publisher URL before they can deduplicate, enrich, or deliver a record.
What was built
A reusable Python package and a Node.js implementation with support for multiple Google News URL formats.
The hard part
The upstream format changes. The current Python package includes alternate decoding paths, proxy support, rate-limit handling, and explicit error responses.
System behavior
- 01Receive an encoded Google News URL.
- 02Extract the decoding parameters.
- 03Try the supported decoding paths and fallbacks.
- 04Return the source URL or a structured failure.