WP Content Crawler - Get content from almost any site, automatically!

WP Content Crawler is a powerful WordPress plugin designed to extract and publish content from virtually any website fully automatically. It is intended for bloggers, online store managers, developers, and digital marketing professionals who need to keep their sites updated with fresh content without spending hours of manual work copying, pasting, and formatting posts.

The plugin works through CSS selectors, a technology that allows you to precisely identify which elements of a source website should be extracted. Thanks to its Visual Inspector tool, you can visually select elements by clicking directly on the target page, without needing advanced programming knowledge. Once configured, the plugin handles the entire process in the background: it collects URLs, extracts content, processes it, and publishes it to your WordPress.

Among its most notable features is the ability to save all details of each post: title, excerpt, content, tags, categories, slug, date, custom metadata, taxonomies, meta keywords, meta description, featured image, and post images. It also allows you to schedule URL collection, post crawling, re-crawling to update existing content, and automatic deletion of posts when the original content disappears.

The plugin is especially useful for creating personal sites that aggregate news from your favorite sources, for WooCommerce stores that need to import products from shopping sites or affiliate programs, for creating test environments with real content, or for keeping track of the competition. It also supports custom post types and custom metadata, making it extremely versatile.

Additionally, it includes a detailed dashboard that shows in real time what is happening: active sites, number of saved, updated, and deleted posts, upcoming scheduled events, and much more. It also offers integration with translation services such as Google Cloud Translation, Microsoft Translator, and Amazon Translate to automatically translate extracted content into other languages.

With support for event scheduling via CRON, advanced filters for processing content, and extensive documentation with video tutorials, WP Content Crawler positions itself as a complete solution for automating content management in WordPress.