How We Test & Evaluate Home Security Systems

We document our evaluation process so you can make an informed judgment about our conclusions. The most important principle: we are honest about what we have tested hands-on and what we have evaluated through desk research.

Quick verdict: All reviews are labeled with their primary evaluation method. Where full hands-on testing has been conducted, it is noted. Where desk research was the primary method, we document exactly what was verified and which sources were used.

Key takeaways

Pricing is verified directly from brand websites before every publish — we capture timestamps
Monitoring quality is evaluated using CSAA Five Diamond data, regulatory filings, and BBB complaint analysis
Smart home integrations are verified through official documentation and Alexa/Google/HomeKit listings
Where hands-on testing has been conducted, it is explicitly noted in the review
We never claim direct product experience we haven't had

Evaluation process by category

Category	Primary method	Sources
Equipment pricing	Desk research (verified)	Brand website, cart screenshots, timestamped
Monitoring quality	Desk research (verified)	CSAA database, regulatory filings, BBB data
Installation process	Desk research + hands-on (where noted)	Manufacturer docs, user guides, hands-on timing
App quality	Desk research + hands-on (where noted)	App store reviews, feature documentation, direct use
Sensor specifications	Desk research (verified)	FCC filings, UL listings, manufacturer specs
Contract terms	Desk research (verified)	Brand website, regulatory filings, sample contracts
Smart home integration	Desk research (verified)	Official docs, Alexa/Google/HomeKit listings

How we verify pricing

Direct website verification: We load the brand's pricing or shop page in a clean browser session and document the advertised price for each plan.
Cart test: We add equipment to the cart where possible to confirm the final advertised price before checkout.
Date stamp: Each price check is timestamped. Pages include a "pricing verified as of [month year]" note.
Quote-based brands: For brands requiring a sales call (ADT, Vivint for some configurations), we use publicly reported price ranges from regulatory filings and news sources — and note this in the review.

Warning: Home security pricing changes frequently. Always verify the current price directly with the brand before purchasing.

Our hands-on testing process

When hands-on testing is conducted, we follow this process:

Equipment purchase: We purchase the system at full retail price — no free samples, no vendor loans.
Timed installation: We time the installation process from unboxing to first armed mode, documenting any difficulties.
App evaluation: We use both iOS and Android apps over a minimum 7-day period.
Monitoring test: We conduct a supervised test alarm and document monitoring center response time and process.
Sensor verification: We verify sensor range, battery life indicators, and smart home integration claims.

Where a system has been evaluated via desk research only, the review is labeled accordingly.

Frequently asked questions

Does SecurityCompassHQ physically test every system it reviews? +

Not yet — we are transparent about this. Our current reviews are primarily based on desk research: verified pricing, manufacturer specifications, UL certification data, FCC filings, and aggregate user data. Where hands-on testing has been conducted, it is explicitly noted in the review. We are building toward full hands-on testing for all Tier 1 systems.

How do you verify pricing if you haven't tested the system? +

We load each brand's website directly in a clean browser session, capture the publicly advertised price for each plan and equipment package, and timestamp the verification date. Where a brand requires a quote (ADT, Vivint for some configurations), we note this in the review and use publicly reported price ranges from regulatory filings and news sources.

What is your process for evaluating monitoring quality? +

We evaluate monitoring quality using: Five Diamond certification status (via the CSAA International database), publicly reported average response times, state regulatory filings where available, BBB complaint data specific to monitoring failures, and user reports of actual dispatch events. We do not fabricate test alarm calls.

How do you evaluate smart home integration? +

We verify listed integrations by checking official documentation, Alexa skill / Google Home action availability, HomeKit certification status, and Z-Wave/Zigbee compatibility filings. Where active integration testing has been conducted, it is noted.

Why don't you test every system hands-on? +

Full hands-on testing of all systems simultaneously requires significant capital for equipment purchases, installation scheduling, and dedicated test environments. We are committed to building toward this. In the interim, we are transparent about our research methodology and clearly distinguish desk research from direct testing.

See our evaluations: All brand reviews use the evaluation process described here. Top reviews: SimpliSafe · Ring · Vivint · ADT

Editorial Content

Company & Trust

Useful Tools

Not sure what you need?

Answer a few quick questions and get a personalised security plan for your home or business.

Build my free security plan →

Takes 60 seconds · No email required to start