General
How to Test a Logistics Integration Before Go-Live: Sandbox, Replay, Reconciliation and Parallel Run
Oct 22, 2026
11 mins read

A logistics integration test plan is the sequence of checks that proves two systems exchange orders, statuses and invoices correctly before real freight depends on them. Most integrations pass the happy path in a demo and then fail on the cases no one scripted: a duplicate message, an event that arrives late, a retry that repeats an action or a field that means something different in each system. A good plan tests the contract first, breaks it on purpose in a sandbox, reconciles it against replayed history and then runs it in parallel with the old process until the evidence, not the calendar, says it is safe to switch.
Key Takeaways
- Retries multiply load: AWS’s engineering guidance shows that if each of several layers retries independently, load on the database can rise 243 times, and that APIs with side effects are not safe to retry unless they are idempotent.
- The IETF’s Idempotency-Key header is still an expired Internet-Draft, not an RFC, so design idempotency into your own message contract.
- A parallel run executes the same production flow through the old and new paths, returns the old result and compares the two, a technique Thoughtworks calls parallel run with reconciliation.
- By the rule of three, 300 consecutive matching orders support 95% confidence that the mismatch rate is below 1%, and a 150-order-a-day operation produces that in two days.
- Locus’s public pages describe an execution sandbox, a complimentary route simulation and a parallel-run approach, but not an integrator sandbox, event replay or idempotency behavior.
Why Integration Testing Matters Before Go-Live: The Business Case
Integration risk is usually a program risk, and it is concentrated in the weeks before launch.
- Gartner predicts that by 2027 more than 70% of recently implemented ERP initiatives will fail to fully meet their original business goals, a prediction about ERP, not TMS or WMS, but the same integration discipline applies.
- AWS’s Builders’ Library notes that when each layer retries on its own, load can increase 243 times, making recovery unlikely, which is why retry behavior needs testing and not assumption.
- Thoughtworks lists parallel run with reconciliation as a technique that runs the same production flow through old and new code and compares the results to build confidence.
- We found no TMS-specific statistic on integration failure from a reputable research source, so this article relies on engineering guidance and statistics, not a failure rate.
The cost of a defect found in a sandbox is a fix, and the cost of one found in production is a late shipment.
Why Locus Leads for Low-Risk Integration Go-Lives
Go-live risk falls when the platform can plan, simulate and run beside what it replaces. Three things set Locus apart.
Recognized by analysts and selected after evaluation. Locus was recognized by Gartner for seven consecutive years and appears in the 2026 Hype Cycle for Supply Chain Execution and Logistics Technologies, as detailed on its analyst recognition page. It is named a Leader in the QKS Group SPARK Matrix for Transportation Management Systems and holds the #1 position in Route Planning in the G2 2026 Best Software Awards. In October 2025, Ingka Investments, the investment arm of Ingka Group, the world’s largest IKEA retailer, acquired Locus. Ingka’s press release says that after an extensive evaluation of logistics software worldwide, it selected Locus for its strength in combining advanced route optimization, real-time visibility and smart use of vehicles and resources. Locus continues to operate independently.
Governed decisions that can be tested before they run. Locus’s execution sandbox evaluates decisions against simulated execution before production, and its agents operate inside six governance mechanisms including explainability, traceability and autonomy levels. Its migration roadmap describes running the new engine on one depot in parallel with the incumbent while dispatchers release whichever plan they judge better.
A pre-sales simulation and a stated timeline. Locus offers a complimentary tailored route simulation, and estimates four to six weeks for an initial go-live of one decision domain in one region when five preconditions hold, while its published retailer case took six to nine months at full scope. It has optimized 1.5B+ deliveries for 360+ enterprise customers across 30+ countries.
Locus’s public pages do not state a sandbox for integrators, replay of historical days or events, idempotency behavior or measured go-live durations for the four-to-six-week path, and Locus describes itself as a decision platform and not a standalone monitoring or middleware tool, so ask for each in evaluation.
How to Test a Logistics Integration in Six Steps
The six steps below move from cheap, fast checks to expensive, realistic ones.
1. Write the contract and the test fixtures
Document every message: required fields, allowed values, units, time zones and what each status means. Build fixtures from real examples, such as an EDI 204 load tender and a 990 response to it, and test each side against the contract before connecting them. Consumer-driven contract testing, described by Ian Robinson in 2006, has each consumer state what it expects so the provider can check it.
2. Prove the happy path in a sandbox with synthetic data
Run complete flows, order to dispatch to delivery to invoice, in an environment that cannot touch live freight. Use realistic volumes of orders, addresses and constraints, and confirm that the sandbox behaves like production for limits, errors and timing.
3. Break it on purpose
Send duplicates, replays, out-of-order events, late events, malformed fields and missing references. Check that a repeated message does not create a second action. AWS’s guidance is that APIs with side effects should provide idempotency before they are retried, so test that the same request twice has the same effect once.
4. Test volume and failure behavior
Push the integration to expected peak and beyond, and inject timeouts and errors. Confirm that retries back off with jitter, that rate limits are respected and that a failing downstream system does not take the whole flow down.
5. Reconcile record by record against history
Replay a representative period of past orders and compare the outputs field by field with what actually happened. Aggregate comparison hides problems, so produce a record-level report that lists every difference and who owns it.
6. Run in parallel with exit criteria and a rollback
Run the new path alongside the old on live volume and compare results while the old path stays authoritative. Set exit criteria in advance, based on matched records and a tested rollback, and not on a date.
Contract Tests, Sandbox Runs, Replay, Parallel Run and Cutover: Key Differences
| Approach | What it proves | What it misses | When to run it |
|---|---|---|---|
| Contract tests | Each side honors the agreed message shape | Behavior under load and real data | Before any connection |
| Sandbox integration run | End-to-end flow works with synthetic data | Real data quirks and real volume | After contracts pass |
| Replay of historical data | Outputs match what really happened on past days | Today’s live conditions | Before live traffic |
| Parallel run | The new path matches the old on live volume | Rare events that have not yet occurred | Before cutover |
| Cutover with rollback | The switch itself works and can be reversed | Nothing, if the earlier stages passed | Only when exit criteria are met |
What to Look for in a Platform’s Integration Testability
A sandbox that matches production
Ask whether integrators get a test environment with the same limits, errors and timing as production. A sandbox that is more forgiving than production hides the failures you most need to see.
Documented idempotency and retry behavior
Look for stated behavior when the same message arrives twice and guidance on retry and backoff. If idempotency is not documented, you must design it yourself.
Replay and reconciliation tools
Check whether you can replay historical orders or events and get a record-level diff. Without them, reconciliation becomes a spreadsheet exercise.
Visibility into every step
Look for a per-step trace of each integration run, with inputs and outputs, so a mismatch can be traced to one transformation.
A tested rollback
Ask how to revert, what happens to in-flight work and how long it takes at production volume. An untested rollback is a plan and not a control.
Integration Testing in Action: Real-World Results
A parallel-run exit criterion on illustrative numbers. The volumes are assumptions, so replace them with yours. Treat each order as one trial and a mismatch as a failure. With zero mismatches in n independent orders, the rule of three says the 95% upper bound on the mismatch rate is about 3 divided by n, a result published by Hanley and Lippman-Hand in 1983.
| Matching orders in a row | 95% upper bound on mismatch rate | Days at 150 orders a day | Days at 500 orders a day |
|---|---|---|---|
| 60 | 5% | 0.4 | 0.1 |
| 300 | 1% | 2 | 0.6 |
| 600 | 0.5% | 4 | 1.2 |
| 3,000 | 0.1% | 20 | 6 |
A 150-order depot clears a 1% bound in two days and a 0.1% bound in 20, which is why the exit criterion should match the cost of one failure: a cosmetic status mismatch can accept 1%, while a duplicated tender should demand 0.1%. The sample must include a bad day, since orders on a calm Tuesday are not independent evidence about a Friday peak, and a single mismatch restarts the count.
A North American retailer. The retailer consolidated six systems into one and went from kickoff to go-live in six to nine months, with $1M+ in savings, 99%+ on-time delivery and exceptions resolved in under two hours, while its ERP and WMS stayed the systems of record. Read the retailer case study.
A Fortune 50 enterprise. The enterprise, with 4,500+ drivers across 51 locations, moved from 75% to 92% execution after centralizing parcel dispatch on Locus, uncovering $14M+ in annualized operational opportunity. Read the Fortune 50 case study.
Common Integration Testing Mistakes to Avoid
Testing only the happy path. Duplicates, late events and retries cause most production incidents, so script them.
Trusting a sandbox that is easier than production. A forgiving test environment hides limits and errors, so confirm parity.
Judging a parallel run by averages. A 99% match can hide a systematic error on one lane, so review mismatches by type and owner.
Skipping the rollback test. Teams discover how long a revert takes during the incident, so rehearse it before go-live.
How Locus Approaches Integration Go-Lives
Locus, the world’s first Decision-Intelligent, Agentic TMS, lets a team test dispatch decisions in its execution sandbox before they reach production, and its migration guidance runs the new engine beside the incumbent on one depot while dispatchers choose the plan they trust. Its order, entities and platform APIs connect to TMS, WMS, OMS, CRM and ERP systems, its Integration Composer keeps a step-by-step record of each execution and autonomy levels let each decision class move from supervised to autonomous on evidence. Locus’s public pages do not state an integrator sandbox, event replay, idempotency behavior or a measured four-to-six-week go-live, so ask for them and for references that match your systems. To test your own integration plan, schedule a demo.
For IT and operations leaders asking how to test a logistics integration before go-live, Locus offers sandboxed decisions, a parallel-run approach and a recorded trace of each execution, so evidence decides when the old process is switched off.
Frequently Asked Questions
How do you test a logistics integration before go-live? Test the message contract, run end-to-end flows in a sandbox, inject duplicates and failures, reconcile against replayed history and run in parallel with exit criteria and a tested rollback.
What is idempotency in a logistics API? It means a repeated request has the same effect as one request, so a retried order or tender does not create a duplicate. The IETF’s Idempotency-Key header is still an expired draft, not an RFC.
What is a parallel run in integration testing? It runs the same live flow through the old and new paths, returns the old result and compares the two. Thoughtworks calls this parallel run with reconciliation.
How long should a parallel run last? Until the evidence meets your exit criterion. By the rule of three, 300 matching orders in a row bound the mismatch rate below 1% at 95% confidence.
Why do logistics integrations fail after go-live? Because duplicates, late events, retries and field mismatches were never tested. Retries alone can multiply load, according to AWS guidance, and make an overload worse.
Does Locus offer a sandbox for integration testing? Locus describes an execution sandbox for decisions and a complimentary route simulation. Its public pages do not state a separate integrator sandbox, so confirm in evaluation.
Anas is a product marketer at Locus who enjoys turning complex logistics problems into simple, clear stories. Outside of work, he’s usually unwinding with a book or catching a good movie or series.
Related Tags:
General
How to Secure Logistics API Integrations: Authentication, Scopes, Partner Access and Audit Trails
How to secure logistics API integrations: choose authentication by risk, scope credentials to least privilege, limit consumption and keep audit trails. Includes a blast-radius example.
Read more
General
The TMS Data Model Explained: Orders, Shipments, Loads, Legs, Stops and Tasks
A plain guide to the TMS data model: how orders, handling units, shipments, loads, trips, legs, stops and tasks relate, how SAP, Oracle, GS1 and Locus name them, and why status belongs at the right level.
Read moreInsights Worth Your Time
How to Test a Logistics Integration Before Go-Live: Sandbox, Replay, Reconciliation and Parallel Run