Webflow to Next.js Migration: The Complete 2026 Guide (Why, How, Costs & Services)
How to migrate from Webflow to Next.js in 2026: why teams switch, a step-by-step process, real cost ranges, and how to choose a migration partner.
David ThomsonDavid Thomson
CTO
David is the CTO of TechnologyChecker, responsible for the engineering and architecture behind the platform's crawling infrastructure. Before joining TechnologyChecker, he spent five years at Google on the Search team, where he worked on large-scale crawling and indexing systems that shaped his approach to building high-performance data infrastructure.
He oversees the detection systems that scan over 50 million domains monthly, ensuring accurate and timely identification of technology stacks across the web. His work focuses on scalable data pipelines, real-time processing, and maintaining detection accuracy across HTTP headers, JavaScript libraries, DNS records, and HTML patterns.
Based in Edinburgh, David is a devoted single malt whisky enthusiast when he's not architecting distributed systems.
Areas of Expertise
Scalable Data PipelinesReal-Time ProcessingWeb Crawling ArchitectureDistributed Systems
Credentials
- MEng Computer Science, University of Edinburgh
- AWS Solutions Architect Professional
- Contributor, Open Source Crawling Frameworks
Achievements
- Architected infrastructure processing 50M+ domain scans per month with 99.9% uptime
- Reduced detection latency from hours to under 60 seconds for real-time alerts
- Built a technology fingerprinting engine covering HTTP headers, JS libraries, DNS records, and HTML patterns
- Analysed petabytes of Common Crawl data to power TechnologyChecker's historical technology adoption database
David’s Impact
Written from real expertise — every post adds first-hand know-how and original insights.
Articles
10Total reads
1.3KHours of work
240hTopics covered
10Top articles by reads
All-time- 1Web Traffic Statistics Q2 2026: We Analyzed Billions of Requests - Here Are the 15 Numbers That Matter (July 2026 Update)348 reads42 min read~31.5h spent creating the content
- 2We analyzed HTTP protocol adoption in 2026: 27.8% of the web still runs HTTP/1.x (July 2026 Update)320 reads70 min read~36.5h spent creating the content
- 3We Analyzed robots.txt Across Cloudflare's Network: Which AI Crawlers Get Blocked Most and Why (July 2026 Update)266 reads52 min read~33h spent creating the content
- 4We Analyzed 8.7B SSL Certificates: ECDSA Overtook RSA in May 2026 (July 2026 Update)220 reads47 min read~29h spent creating the content
- 5DMARC adoption statistics 2026: 89% of emails pass DMARC but 14.5% still fail SPF (July 2026 Update)77 reads46 min read~27h spent creating the content
Content effort estimates the hours David spent researching and creating each post. Every article is written in David’s field of expertise, so it carries first-hand know-how and unique insights — not commodity information rehashed from elsewhere.
Articles by David Thomson
David Thomson
•Updated
AI Crawler Statistics in 2026: What AI Crawlers Actually Want?
Live Cloudflare Radar data: training is what AI crawlers hunt most, and its share of AI crawl jumped from 29% to 45% year over year. Shopping sites get crawled hardest. What AI bots want from your site, verified.
David Thomson
•Updated
Bot Traffic Statistics 2026: How Much of the Web Is Bots?
Live Cloudflare Radar data: bots are 35% of web traffic and Anthropic now out-crawls OpenAI and Meta. Year-over-year, crawler block rates jumped from 10% to 36% since 2025. Verified bot statistics.
David Thomson
•Updated
Technology Detection Methods: How We Scan 50M+ Domains
Technology detection explained: we match 6,675 technologies across 14 signal types on a 50M-domain database, re-crawled monthly and scored 0–100.
David Thomson
Open-Source AI Adoption 2026: 5.6M Projects vs Real Deployment
Stanford counts 5.6M open-source AI projects. We scanned 50M+ domains for what's deployed: Botpress leads at 1,558 vs 52,682 for the closed OpenAI API.
David Thomson
•Updated
Web Traffic Statistics Q2 2026: We Analyzed Billions of Requests - Here Are the 15 Numbers That Matter (July 2026 Update)
Our Q2 2026 refresh of Cloudflare Radar web traffic data, with year-over-year comparisons to Q2 2025. 33.2% of all HTTP requests are now bots, up from 30.4% a year ago. ECDSA certificates crossed RSA (50.3% of new certs, nearly double last year's 26.5%), Googlebot's share of AI-bot traffic more than halved as ClaudeBot rose to #2, UDP now drives 82.6% of network-layer attacks, and compromised-credential logins fell to 57.4%. All-traffic shows desktop leading, but human-only traffic is still mobile-majority. Here are the numbers that matter.
David Thomson
•Updated
DMARC adoption statistics 2026: 89% of emails pass DMARC but 14.5% still fail SPF (July 2026 Update)
DMARC adoption analysis from Cloudflare Radar, refreshed for the Q2 2026 close with full-quarter data and the first year-over-year layer. Adoption kept improving (DMARC 'NONE' fell to 5.70%), but inbound spoof attempts doubled to 24.3% and malicious mail tripled to 18.7% while bulk spam fell, as attackers shifted from volume to targeted impersonation. Encryption in transit slipped to 88.2% and deprecated TLS climbed to 51.1%. Full Q2 scorecard, the year's most-abused sending TLDs, and what a full year changed.
David Thomson
•Updated
We analyzed HTTP protocol adoption in 2026: 27.8% of the web still runs HTTP/1.x (July 2026 Update)
At the Q2 2026 close HTTP/1.x holds 27.8%, HTTP/2 leads at 51.2%, and HTTP/3's plateau is now a full year old (20.5% to 21.0% year over year). Our Cloudflare Radar refresh adds the year-over-year picture: post-quantum crypto crossed the majority of requests (28.9% to 54.2%) while barely reaching origins (9.6%), the Russia anomaly reverted exactly as predicted, and the Netherlands overtook Singapore as the HTTP/1.x leader.
David Thomson
•Updated
We Analyzed robots.txt Across Cloudflare's Network: Which AI Crawlers Get Blocked Most and Why (July 2026 Update)
robots.txt analysis across Cloudflare's network, refreshed for the Q2 2026 close with year-over-year data: AI crawler-to-refer ratios converged (Anthropic's collapsed 18x but stayed worst), the 403 block rate on AI bots more than doubled, and a data-driven framework for blocking AI bots.
David Thomson
•Updated
We Analyzed 8.7B SSL Certificates: ECDSA Overtook RSA in May 2026 (July 2026 Update)
We process ~80% of global CT logs. ECDSA overtook RSA in May 2026 and held the majority across the full Q2 (50.3%, up from 26.5% a year earlier). The Q2 2026 close with year-over-year shifts: the 200-day certificate cliff (10.8% to 0.10%), Amazon's CA surge, IP-address certificates, and what certificates reveal about backend tech stacks.
David Thomson