Authority Industries Ratings and Reviews Methodology
The ratings and reviews methodology used by Authority Industries establishes the structured framework by which home service contractors are evaluated, scored, and ranked within the directory network. This page documents the specific inputs, weighting logic, classification rules, and known tradeoffs embedded in that methodology. Understanding how scores are produced and what they do — and do not — represent is essential for interpreting contractor listings accurately.
- Definition and Scope
- Core Mechanics or Structure
- Causal Relationships or Drivers
- Classification Boundaries
- Tradeoffs and Tensions
- Common Misconceptions
- Checklist or Steps
- Reference Table or Matrix
Definition and Scope
A ratings and reviews methodology, in the context of a contractor directory, is the documented set of rules that determines how qualitative and quantitative inputs are combined into a standardized score or designation for each listed provider. The methodology governs which inputs are accepted, how they are verified, how heavily each factor weighs in the final output, and under what conditions a score is suppressed, flagged, or recalculated.
The scope of the Authority Industries methodology covers all active contractors listed across the Authority Industries service category index and extends to every trade vertical represented in the network. It applies uniformly regardless of a contractor's tenure, geographic market, or membership tier. The methodology does not produce a single numerical score in isolation — it produces a composite designation built from at least 4 distinct input categories, each tracked and weighted independently before aggregation.
This methodology operates alongside, but separately from, the authority-industries-vetting-process, which governs initial eligibility. A contractor can pass vetting and still receive a low composite rating if post-listing performance data is weak.
Core Mechanics or Structure
The composite rating is built from four primary input categories:
1. Verified Consumer Feedback
Consumer reviews are accepted only when the submitting homeowner can be matched to a confirmed service transaction. Unverifiable reviews — those lacking a job record, invoice reference, or contractor-corroborated timestamp — are excluded from scoring. Each verified review contributes a 1–5 integer rating on three sub-dimensions: workmanship quality, punctuality, and communication. The sub-dimension scores are averaged before being rolled into the composite.
2. Credential and Compliance Standing
This input pulls from the same data streams that feed the authority-industries-licensing-requirements-by-trade and authority-industries-insurance-standards pages. Contractors holding active, jurisdiction-appropriate licenses and current insurance certificates receive full credit on this dimension. Any lapse — even temporary — triggers a score reduction until documentation is restored and reverified.
3. Complaint and Dispute History
Formal complaints logged through the authority-industries-dispute-resolution-process are weighted negatively. The weight applied scales with complaint severity: unresolved complaints carry 3× the negative weight of complaints resolved within the published general timeframe. Complaints that are resolved within 72 hours and rated favorably by the homeowner may be weighted neutrally.
4. Contractor Performance Metrics
Objective operational data — including on-time arrival rates, quote-to-final-price variance, and repeat-hire rates — contribute to this dimension. These metrics are collected passively through platform interactions and do not rely on homeowner self-reporting. The authority-industries-contractor-performance-metrics page details how each metric is defined and measured.
The four categories are weighted at approximately 40%, 25%, 20%, and 15% respectively in the composite formula. These weights are reviewed on a 12-month cycle and adjusted when audit data reveals systematic distortion.
Causal Relationships or Drivers
Several upstream factors drive rating outcomes in ways that are not always visible to the reader of a listing.
Review volume asymmetry is the most significant driver of score instability. A contractor with fewer than 10 verified reviews has a composite rating that is mathematically volatile — a single 1-star submission can shift the aggregate by 0.4 points or more. Contractors with 50 or more verified reviews show statistically stable scores that move less than 0.1 points per new submission under normal conditions.
Credential currency operates as a binary gate within the compliance dimension. A contractor who allows a license to lapse — even for 30 days during a renewal processing delay — receives a score suppression that persists until the lapse is formally closed in the licensing authority's public record. This can produce a visible score drop that does not reflect actual service quality.
Geographic market density affects complaint ratios. In markets where a single contractor handles a disproportionate share of local volume, the absolute count of complaints will be higher even if the complaint rate per job is lower than average. The methodology normalizes complaint counts against job volume to prevent high-volume contractors from being penalized for scale.
Seasonal demand spikes create scoring lag. During high-demand periods for trades like HVAC or roofing, review submission rates drop because homeowners are focused on project completion. This can cause an artificial score plateau for 60–90 days following peak seasons.
Classification Boundaries
Contractor designations fall into four tiers based on composite score ranges:
- Preferred — composite score of 4.5 or above, with no open unresolved complaints and full credential currency
- Approved — composite score of 3.8 to 4.49, with no more than 1 unresolved complaint in the trailing 90 days
- Standard — composite score of 3.0 to 3.79, or any score where credential status is under review
- Conditional — composite score below 3.0, or any contractor with 2 or more unresolved complaints regardless of score
A contractor cannot hold Preferred status if the compliance dimension score falls below its full-credit threshold, even if the other three dimensions average high enough to produce a composite of 4.5 or above. This floor rule prevents a contractor with lapsed insurance from appearing in the highest designation category.
Conditional status triggers an automatic 30-day review window. If the score does not improve to 3.0 or above within that window — or if unresolved complaints remain open — the listing is suspended pending a full administrative review aligned with the authority-industries-verified-contractor-criteria.
Tradeoffs and Tensions
Verification strictness versus review volume: Requiring transaction matching before accepting a review suppresses fraudulent submissions but also reduces total review counts, particularly for contractors who handle cash transactions or work outside platform-mediated jobs. Lower verified review counts increase score volatility.
Recency weighting versus historical fairness: Applying heavier weight to reviews submitted within the trailing 12 months rewards service improvement but can erase a strong long-term record. A contractor with 8 years of high scores can see their designation drop if 6 recent reviews are below average — even if those 6 reviews represent a temporary staffing disruption.
Complaint normalization versus simplicity: Normalizing complaint counts against job volume is more accurate but less intuitive. A homeowner reading a listing may not understand why a contractor with 14 logged complaints holds a higher designation than one with 3 complaints, even though the higher-volume contractor's complaint rate per 100 jobs is significantly lower.
Credential automation versus processing delays: Pulling license data from state licensing boards in near-real-time catches lapses quickly but also catches administrative processing delays that do not represent actual non-compliance. This creates false negatives — score suppressions for contractors who are legitimately licensed but whose renewal paperwork has not yet cleared the state system.
Common Misconceptions
Misconception: A high star rating means no complaints have been filed.
Correction: Complaints are tracked on a separate dimension from consumer star ratings. A contractor can hold a 4.7 consumer review average and simultaneously have 2 open complaints that are suppressing their composite below Preferred status.
Misconception: Newer contractors start with a neutral score.
Correction: Contractors with fewer than 5 verified reviews receive a provisional designation rather than a scored rating. The provisional designation is displayed differently from scored tiers and cannot be interpreted as equivalent to a 3.0 composite.
Misconception: Removing a negative review improves a contractor's score.
Correction: Individual reviews are not removed based on contractor requests. The only pathway to review removal is a demonstrated verification failure — proof that the review was submitted without a matching transaction record. Score recalculation occurs automatically when a review is removed on those grounds, but the process is initiated by the methodology engine, not by the contractor.
Misconception: The methodology weights all trades identically.
Correction: Trade-specific adjustments apply in the performance metrics dimension. Trades with higher regulatory complexity — licensed electrical, plumbing, and structural work — carry a higher compliance dimension weight than general handyman or landscaping categories, reflecting the differential risk profile documented in the authority-industries-consumer-protection-framework.
Checklist or Steps
Elements verified before a review is counted toward a contractor's composite score:
- Homeowner identity matched against a confirmed service transaction record
- Service date confirmed within the platform's transaction log or invoice archive
- Review submission timestamp falls within 180 days of the service completion date
- Contractor's listing status is active at the time of review submission
- Sub-dimension ratings (workmanship, punctuality, communication) are all present — partial submissions are held pending completion
- Duplicate submission check completed against the same homeowner-contractor pair within a rolling 90-day window
- Language screening completed for content that would trigger suppression under platform content standards
- Final review logged in the composite recalculation queue for processing within 48 hours
Reference Table or Matrix
| Input Category | Weight in Composite | Data Source | Update Frequency | Score Direction |
|---|---|---|---|---|
| Verified Consumer Feedback | 40% | Transaction-matched homeowner submissions | Continuous (48-hr processing queue) | Positive or negative |
| Credential and Compliance Standing | 25% | State licensing board records; insurance certificate registry | Real-time pull with 24-hr sync lag | Binary (full credit or reduced) |
| Complaint and Dispute History | 20% | Dispute resolution system logs | Continuous; resolved complaints recalculated at closure | Negative (scaled by severity) |
| Contractor Performance Metrics | 15% | Platform operational data (arrival, quote variance, repeat hire) | Monthly batch recalculation | Positive or negative |
| Designation | Composite Score Range | Complaint Condition | Credential Condition |
|---|---|---|---|
| Preferred | ≥ 4.5 | Zero open unresolved | Full currency required |
| Approved | 3.8 – 4.49 | ≤ 1 unresolved (trailing 90 days) | Full currency or minor lapse under review |
| Standard | 3.0 – 3.79 | No specific limit | Credential review may be active |
| Conditional | < 3.0 or ≥ 2 unresolved | 2+ unresolved triggers regardless of score | Any lapse triggers at minimum |
References
- Federal Trade Commission — Consumer Reviews: What Businesses Need to Know
- National Association of State Contractors Licensing Agencies (NASCLA)
- Consumer Financial Protection Bureau — Complaint Database Methodology
- U.S. Small Business Administration — Licensing and Permits
- American National Standards Institute (ANSI) — Rating and Scoring Standards Overview