remoet.devJobsCompaniesMCPMarketBlog

Posts tagged “meta”

1 post
Meta's AI Crawler Kept Crashing Our Job Board for Two Days. We Have the Receipts.

Meta's AI Crawler Kept Crashing Our Job Board for Two Days. We Have the Receipts.

Meta's AI training crawler hit us at 1,000 pages an hour from 76 rotating IPs, ignoring robots.txt, until our backend was in a crash loop. We caught it, blocked it, and did the usage-billing math.

Meta12 min read
Track tech jobs
from companies
you love.
HomeListingsCompany directoryJobsBlogTech stacksCompanies by locationMCP serverRemoet for HermesRemoet for OpenClawSubmit listing
issueswelcome
Made by human
Sponsored by~/crabstackCrabStackcrabstack.dev$ The full-stack template made for AI agentsGet CrabStack →(opens in a new tab)
Privacy PolicyTerms of ServiceCookie Policy
Fazier badgeFeatured on Sky LaunchFeatured on Wall of ToolsFeatured on EasyDoFollowFeatured on EasyLaunchRemoet on Nick LaunchesLaunched on LaunchPandaFeatured on Twelve ToolsFeatured on Wired Business

Built withTypeScriptand ☕️. All rights reserved, copyright remoet.dev 2026