Insights:Technical SEO & Structured Data Tools and Commands: Ready-to-Use
Command 1: Check status codes and redirects
curl -I https://example.com/page
curl -IL https://example.com/page
Look for:
- Whether it returns a 200 status.
- Whether there are multiple redirect hops.
- Whether the final URL matches the desired canonical version.
Command 2: Check robots.txt
curl https://example.com/robots.txt
Confirm that:
- No sections or resources are accidentally blocked.
- The sitemap URL is correctly specified.
- Search result pages and backend paths are disallowed.
Command 3: Check sitemap
curl https://example.com/sitemap.xml
Confirm that:
- Only indexable URLs are included.
- All core pages are present.
- There are no 404 or noindex pages.
- Last modified dates look reasonable.
Command 4: Check canonical tags and meta information
curl -s https://example.com/page | grep -i canonical
Ensure the canonical tag points to itself or a single canonical version, and not to a 404 page, a redirect chain, or an unrelated page.
Command 5: Check structured data
curl -s https://example.com/page | grep -A 20 'application/ld+json'
Verify:
- The JSON is parseable.
- All required fields are present.
- It matches the visible content on the page.
Online Tools
| Tool | Purpose | When to Use |
|---|---|---|
| Search Console | Indexing, crawling, and queries | Weekly |
| Rich Results Test | Schema validation | Before launch |
| Structured Data Testing Tool | Syntax and fields | After template changes |
| PageSpeed Insights | Core page speeds | After redesigns |
| Log Analysis | Crawl frequency and paths | Monthly |
Crawling Preview
Use Search Console's URL Inspection tool or a browser with scripts disabled, then verify:
- Title and body text are visible.
- Internal links are crawlable.
- There's no empty shell prompting users to enable JavaScript.
Diagnosis Principles
- Prioritize status codes: fix 404s, 5xx errors, and redirect chains first.
- Next, check indexing: review noindex tags and canonical URLs.
- Then review content: ensure the crawled view is complete.
- Finally, check markup: Schema should only annotate actual content.
Pre-launch Spot Check (Last 15 Minutes)
- Pick 3 pages to check status codes.
- Check robots.txt and sitemap.
- Check canonical tags.
- Run a Schema validation test.
- Check the crawl preview.
Notes
The commands and tools provide technical clues, but they do not replace content quality assessment and competitor analysis. Differences across CDNs, frameworks, and JS rendering methods are expected—cross-validate key pages with multiple tools.
Related reading: