The idea, in plain English
Start here.
Start an improvement decision with a trustworthy action definition, comparable scope and sufficiently mature data. Diagnose a specific problem before changing settings. For an experiment, state the hypothesis, intended measure and comparison method in advance and keep unrelated changes controlled. A platform score, a recent zero or a better-looking percentage is not by itself proof of business improvement.
A campaign’s newest days show fewer conversions. A mobile form also has a reproducible error, and the account suggests a budget increase. Those findings need different responses. This lesson turns a busy dashboard into a short decision record with a reason, a next action and an honest limit.
A few words you’ll meet.
OPEN WHAT YOU NEED ↙Diagnostic
Information that helps investigate a possible issue. It does not automatically identify the cause or measure the final business result.
Conversion lag
The delay between an ad interaction and a conversion action. Recent reporting can still be incomplete.
Hypothesis
A specific expected effect with a reason and a way to evaluate it. It should be written before the test result is known.
Inconclusive
The collected evidence does not justify choosing a winner or making the proposed claim. This is a valid result to preserve.
Check what the reported result actually contains
Confirm the action, reporting period and relevant scope before comparing totals. Was the goal changed? Did an import arrive late? Are the newest days less mature than the comparison period? Google documents conversion lag because actions can happen after the interaction and make recent cost or return metrics look worse before the data fills in.
Keep clicks, accepted inquiries, suitable inquiries and paid repairs distinguishable. Compare the same definitions and investigate measurement failures before interpreting a rate change as customer behavior. An aggregate difference may also reflect a different mix of queries, devices or services. It is a finding to understand, not a diagnosis already completed.
Separate a verified defect from an open question
A reproducible form failure has a direct acceptance condition: correct it and verify that valid requests can be accepted without creating false success signals. You do not need to leave a known broken path in place merely to call the repair an experiment. Record the fix and retest the affected task.
A question such as ‘Will a clearer estimate-request label improve the task?’ needs a hypothesis and evaluation. Avoid treating every low-rate keyword as irrelevant, every expensive click as bad or every account recommendation as a command. Google’s optimization score can change when recommendations are applied or dismissed. Movement in that score is not a record of additional customers.
One question belongs on the test bench.
Write a small experiment plan before editing
Tie the question to the job: helping suitable customers submit a clear estimate request. Define the exact change, the outcome you will examine and any guardrail needed to avoid improving a superficial action while harming the actual result. Preserve the existing version and record the assumptions.
Google’s experiment guidance recommends a clear hypothesis, one variable at a time, chosen success measures before the test and retained records. Have the authorized owner choose a supported method appropriate to the question and account. Keep offer, targeting, bidding, budget and measurement stable where the design requires it. Changing all of them at once makes it difficult to tell which change explains a difference.
Read the result and decide what follows
Use the planned review method, sufficient relevant observations and appropriate conversion-maturity context. Do not stop only because an early percentage looks favorable. Record any unexpected changes, missing data and uncertainty. A controlled comparison needs its actual design and analysis; a before/after screenshot does not become an experiment merely because only one edit was intended.
Decide whether to keep, revise, investigate further or stop for a supported reason. An inconclusive result can still reveal a measurement gap or a poorly framed question. Save the old/new versions, setup, observations and decision so the next review builds on the evidence. There is no universal number of days, clicks or conversions that guarantees every test has a trustworthy answer.
Three findings with different next steps
Original fictional review notes for the repair studio. No live campaign metrics, automated changes or experimental outcome are asserted.
| Finding | Appropriate next step | Limit to retain |
|---|---|---|
| Valid mobile submissions fail reproducibly | Repair the defect and verify accepted-request behavior | A working form does not guarantee more suitable customers. |
| Newest conversion period looks weaker | Check tracking, action definitions and normal lag before judging | Recent data may not be comparable with a mature period. |
| The estimate-request label may confuse readers | Plan a narrow truthful-label evaluation with a defined measure | The hypothesis has not yet been tested; do not announce a winner. |
Put it into practice
Write the next decision in one page
After the fictional mobile defect is fixed and verified, the studio wants to examine whether a clearer label helps people understand the estimate request. Both proposed labels must describe the same truthful action.
- Write the question and exact label change without changing the offer.
- Name the outcome and a useful quality check before observing results.
- List the other conditions and measurement definitions the comparison needs to preserve.
- State who will choose the supported method and check data maturity and adequacy.
- Describe the evidence you would save and what an inconclusive result means.
Keep your working notes in your own document. This page saves only your completion check, not your answers or customer data.
Check your understanding
Make the call.
Choose an answer for each question. Then compare the reasoning.
You have a useful next step.
- Verify definitions, scope and data maturity before judging a rate.
- Separate a known defect from an uncertain improvement.
- Plan the comparison and preserve the result, including uncertainty.
Completion is your own learning record. Quiz scores and practice checks are saved separately, on this browser.
Sources & context
The sources below explain the factual foundations and editorial methods used in this lesson. Worked examples, planning models and exercises are illustrative teaching material.
- Google Ads: Test with confidence with the Experiments page
Primary guidance on hypotheses, one-variable comparisons, prespecified success measures and retained experiment records.
- Google Ads: About conversion lag reporting
Primary explanation of delayed actions and immature recent CPA/ROAS reporting.
- Google Ads: About optimization score
Full English primary document as collected; score changes with settings/recommendations, including application or dismissal. It is not a customer-growth percentage.
