Straightening Tolerance 101: What 0.01mm, 0.05mm and 0.1mm Mean | SHANGDA

A drawing arrives with “straightness 0.05 mm” in the tolerance box. Everyone in the chain nods — design, purchasing, the straightening supplier — and each pictures a different difficulty level. To one engineer 0.05 mm is routine; to another it is a precision-class requirement that decides the machine, the cycle time and the price. This guide decodes the numbers shaft buyers actually meet — 0.1 mm, 0.05 mm, 0.02 mm and the often-asked 0.01 mm class — what each demands in measurement and process, and how to choose the number your parts really need instead of the one copied from an old drawing.

By SHANGDA Engineering TeamReading time: 12 minutesFor: purchasing, quality & production engineers

The one idea behind this guide: a straightness tolerance is not a description of the part — it is a price tag on process control. Every digit below 0.1 mm buys something specific: better probes, more measure–press–recheck cycles, tighter fixturing. Specify what your shaft’s function requires and you pay for quality you use; copy a number from another drawing and you either pay for precision nobody needs — or ship bends nobody catches.

01What the number on your drawing really says

A tolerance is the boundary between accept and reject. On a heat-treated shaft, the straightness callout is one of the few numbers that cannot be fixed cheaply later: a bent shaft that reaches grinding with more bend than the grind allowance covers is scrap at the most expensive stage of the route — not rework.

It is also a contract between design intent and shop-floor capability, and like any contract it only works if both sides can check the same thing. A tolerance you cannot measure is a tolerance you cannot hold — which is why the measurement method is half of the specification, not an afterthought.

Two things make the number harder than it looks:

• The same digits mean different difficulty on different parts. 0.05 mm on a stiff 300 mm gear shaft and 0.05 mm on a slender 6 m bar are not remotely the same job.

• What is reachable once is not what is holdable every shift. A master operator touching 0.05 mm on a good morning is not the same as a process that delivers 0.05 mm on the last shaft of the night shift, logged (Section 6).

This is the companion to our TIR and runout measurement guide — that article covers how straightness is measured; this one covers what the values mean and which process can hold them.

02Straightness, runout and TIR — a 30-second recap

Three terms appear on drawings and in quotes, and they are closely related but not identical:

• Straightness is a geometric form requirement: how close the shaft’s axis is to a perfect straight line, regardless of roundness.

• Radial runout is the dial indicator’s swing as the part rotates in supports. On a real shaft it bundles bend — the curvature straightening removes — with out-of-roundness of the section and any eccentricity between the measured surface and the support journals.

• TIR — Total Indicator Reading, sometimes Total Indicated Runout — is the arithmetic of that swing: highest reading minus lowest reading over one full revolution, at one measured section.

In straightening practice, when a drawing or builder says “straightness 0.05 mm”, it almost always means 0.05 mm TIR on the part rotating in defined supports. The reason: a bent shaft running in bearings moves, and TIR measures exactly that movement — predicting vibration, seal wear and bearing life. Pure axis straightness is always smaller than or equal to TIR, but TIR is what the shop floor can check anywhere with V-blocks and a dial gauge — and what builders guarantee.

03mm versus mm/m: the length-basis trap

Straightness requirements are written two ways, and confusing them is one of the most common causes of quotation mismatches and acceptance disputes:

• Total tolerance — a single value over the whole part, e.g. 0.05 mm TIR at any measured section.

• Per-metre tolerance — a rate, e.g. 0.2 mm/m, meaning the allowed deviation grows with length.

The same three digits describe completely different requirements. 0.2 mm/m on a 4-metre bar allows 0.8 mm of total deviation; written as a total tolerance, 0.2 mm over 4 metres equals 0.05 mm/m — four times tighter. The first is a normal general-engineering requirement; the second may not be physically achievable on a bar that length at all.

The per-metre convention exists because deviation naturally accumulates with length: no production process makes a 10–12 m bar straight to 0.05 mm total. General bars, tubes and structural stock are therefore specified at 0.10–0.30 mm per metre; shorter shafts — up to about a metre — are specified as total TIR at the measured sections.

Rule of thumb: every tolerance callout should carry three things — value, length basis and measurement location. If a quote promises “0.05 mm” on a 6-metre bar without saying total or per-metre, stop and ask before you order.

04What 0.1 mm, 0.05 mm, 0.02 mm and 0.01 mm actually mean

Some physical intuition first: 0.1 mm is about the thickness of a sheet of copy paper — or a fine human hair. Work down from there and the numbers stop looking abstract:

• 0.1 mm (100 µm) — the general-engineering class. Generous and forgiving: the part is straightened to align cleanly for machining and assembly, nobody chases microns. Typical of general bars, tubes, structural and auxiliary shafts — and the normal output of a skilled manual-press operator.

• 0.05 mm (50 µm) — the entrance to automotive-class work. Half a hair — where “good operator on a good day” stops being a reliable strategy: holding it part after part needs repeatable measurement and a controlled press–recheck loop, not heroics. Standard CNC machines with electronic probes hold the 0.02–0.05 mm band as their normal range.

• 0.02 mm (20 µm) — the precision class. A fifth of a hair — everything in the loop controlled: high-resolution probes, precision fixturing, parts measured cool after heat treatment, springback predicted and re-checked. The domain of precision screws, piston rods and high-rank hydraulic rods; a manual press cannot hold it in production.

• 0.01 mm (10 µm) — the practical frontier of shaft straightening. One tenth of a sheet of paper. Machines can work down to the 0.01–0.02 mm class, but only on favourable parts — stiff cross-sections, consistent material and heat-treatment condition, high-resolution measurement. It cannot be promised for every workpiece; any supplier promising 0.01 mm sight-unseen is selling a marketing number. The honest answer: discuss the 0.01–0.02 mm class — and prove it on samples.

Note that cost is not linear: from 0.1 to 0.05 mm you mostly buy process discipline — fixed probes instead of a hand-held gauge, a closed loop instead of judgment. Below 0.05 mm you buy measurement resolution, fixturing precision and cycle time, as the last few microns take a disproportionate share of measure–press–recheck cycles. The tightest number on the drawing is where the quote and the cycle time are decided.

05How the number is actually checked

The shaft rests on precision V-blocks or between centers — on machined journals, never a rough surface — a dial indicator sits perpendicular to it, and the part is rotated one full turn by hand. TIR at that section is the highest reading minus the lowest. The gauge is moved along the shaft and repeated: 2–3 sections cover most short shafts; long shafts and bars need 5–8 measurement points, since a bend between two check points is invisible. The worst section governs.

A CNC machine does the same geometry with fixed electronic probes: every section is read automatically, the control builds a bend map, presses the calculated correction, and re-measures after springback in a closed loop until every section passes — logging the result to the part.

Two tolerance truths follow:

• The guarantee is only as good as the agreed method: same supports, same sections, cool parts (not hot off heat treatment), and for long bars an agreed sag treatment. Change one and the number changes.

• A tolerance you cannot measure in production is one you cannot hold: if checking 0.02 mm needs a gauge nobody runs in the cell, the number is aspirational. Probe layout, support spacing and the sag question are detailed in the TIR measurement guide.

06What each straightening process can actually hold

The distinction that matters is not what the equipment reaches once, but what the process holds on every part, every shift, with an operator you can actually hire. The table maps tolerance classes to typical work and the process that holds them consistently.

Two process notes. Manual hydraulic straightening presses remain unmatched for flexibility — up to the 1000-ton class for one-offs, oversize parts and repair work — but results live or die with operator feel, vary with fatigue, and leave no record. Fully automatic CNC lines run the whole measure–press–recheck loop in 20–90 seconds per part — typically 5–10 times faster than manual — identically first shaft to last, with 100% of parts measured and logged; one operator tends 1–2 CNC machines or several automatic lines. The full comparison is in our article on manual vs. automatic shaft straightening.

07Springback, material and heat treatment set the real floor

Straightening is controlled over-bending: the ram presses past straight, the load is released, and the part springs back; the correction that stays is the over-bend minus the springback — and the material decides how small a residual bend is achievable at all:

• Hardened, high-strength steels have large springback and a narrow plastic window: press a little too far and the shaft bends the other way — or cracks. Soft, annealed parts correct easily but can move again as residual stresses relax.

• The bend usually comes from heat treatment — quenching, tempering, carburizing relax residual stresses unevenly. Straightening belongs after heat treat and before finish grinding; stress-relief done afterward can move the parts again, so process sequence matters.

• Springback also varies heat-lot to heat-lot with hardness and yield strength — a fixed stroke learned on one lot mis-corrects the next.

What pushes the tolerance floor down

High hardness and yield strength, slender cross-sections, heavy incoming bend after quenching, and lot-to-lot hardness variation all make the final microns harder to reach — on any machine.

What the closed loop does about it

Per-material recipes with first-piece learning set the starting stroke; force and displacement are monitored together; the part is re-measured after springback and out-of-tolerance sections are re-pressed automatically.

The compensation logic — recipes learned from the first pieces of a batch, converging within a few correction cycles — is covered in our springback compensation article. Takeaway: the achievable number depends on your material and heat-treated condition as much as on the machine class — which is why serious builders ask for samples before guaranteeing anything.

08Mistake one: tolerancing tighter than the job needs

Over-tight tolerances usually arrive by inheritance: a number copied from a legacy drawing, a “house standard” nobody questions, or margins stacked until the box says 0.02 mm for a shaft running at conveyor speed.

The costs are real and all fall on you:

• Cycle time inflates. Chasing the last few microns means extra correction and re-measure cycles per part; the normal 20–90 second window stretches, and throughput drops at the station that is already the bottleneck.

• The equipment class jumps. Below ~0.05 mm you are quoting high-resolution probes and precision fixturing instead of standard electronic probes — a different machine, a different price.

• Suppliers decline, pad the price, or accept and argue at acceptance over microns the application never sees.

Before you sign off a tight number, ask three questions: what does the bearing or seal actually experience in service? What straightness does grinding need as an incoming condition? And is this number driven by function — or by habit? Cost trade-offs are mapped in our straightening machine price guide.

09Mistake two: tolerancing looser than the process can survive

The opposite error is quieter and often more expensive. “Just make it straight” — or an over-generous callout on a shaft that will rotate in bearings — lets bent parts pass, and the problem moves downstream:

• Grinding stock is uneven. Journals on the high side of the bend grind clean; journals on the low side do not — and a shaft that fails to clean up at finish grinding is scrap at finished-part value, the most expensive place in the route to discover a bend.

• Service life leaks away. Residual bend means vibration, noise, accelerated seal wear and shortened bearing life — failures that return as warranty claims and scoreboard hits, with no data trail to defend you.

• The cheap correction window is missed. A bend is cheapest to remove in the seconds right after heat treatment, on the straightening machine. Every station it travels past afterward multiplies the cost of finding it — and a bend found by your customer is the most expensive bend of all.

The fix is not to default to the tightest number either: tie incoming straightness to what grinding needs to clean up and what the part does in service. And require logged measurements — per-part TIR data turns a quality dispute into a five-minute conversation instead of a freight claim.

10How to choose the right tolerance for the part’s job

Work backwards from function, not forwards from the old drawing. The four practical starting points:

• General bars, tubes, structural and welded stock — the 0.10–0.30 mm/m class: straight enough to machine, fit and assemble without drama.

• General machinery shafts, rollers, conveyor and auxiliary shafts — roughly 0.05–0.10 mm TIR.

• Automotive, motor, transmission, pump and gearbox shafts running at speed in bearings — 0.02–0.05 mm TIR, usually with measurement records expected.

• Precision screws, piston rods, high-rank hydraulic rods, high-speed spindles — ≤0.02 mm; raise the 0.01–0.02 mm class with the builder and prove it on samples rather than assuming it.

Ask what the next operation needs

Set incoming straightness so the grind allowance comfortably covers the residual bend. That single calculation prevents the most common — and most expensive — scrap mode at finish grinding.

Ask what the part does in service

Rotating speed, bearing type and seal arrangement set the real requirement. A slow structural shaft and a high-speed transmission shaft do not belong in the same tolerance box.

Three rules finish the job: long parts get a per-metre basis, short shafts get total TIR at the measured sections; if your end customer specifies the value — especially automotive tier-1 customers — that value governs, so budget for per-part data; and when you talk to builders, do not ask “what can your machine do?” Ask “what can you hold on my parts, every shift, measured my way?” — then have them prove it.

11What to send when you ask for a quote

A tight tolerance is not demonstrated by a brochure — it is demonstrated on your workpieces. Send the builder a package that lets them recommend the right process class and prove the result:

Your straightening-tolerance RFQ package

1. Drawings with the straightness/TIR callout — value, length basis (total or per metre), measurement sections and support method.

2. Material and heat-treatment condition — quenched and tempered, carburized, normalized; hardness range if you have it.

3. Dimensions — diameter and length. Machines cover Ø5–600 mm in diameter and 100 mm to 12 m in length (longer bars straightened in sections); a given model typically covers one diameter band, for example Ø20–120 mm.

4. Incoming condition — measured runout before straightening on your real heat-treated parts. This sets the correction capacity and tonnage the machine needs.

5. Target TIR after straightening, and whether per-part measurement records are required.

6. Batch quantities per year and the part-family mix — this decides manual press, CNC cell or fully automatic line.

The complete RFQ checklist is in our shaft straightening machine buyer’s guide; the manual vs. automatic comparison lays out the process choice; the five-part way to write a TIR spec is in the TIR measurement guide. Expect a capable builder to request samples and run a trial with before/after data. Built-to-order machines typically deliver in 60–120 days; facilities are ordinary — 380–480 V three-phase supply.

12Frequently asked questions

Send your drawings — and see your tolerance proven on your parts

Since 2008, SHANGDA has built manual hydraulic presses, CNC semi-automatic cells and fully automatic straightening lines for shafts, bars, tubes, racks and screws from Ø5 mm to 600 mm, CE certified. Send your drawings, material and heat-treatment condition and target TIR; our engineers will recommend the process class that holds your tolerance on every shift — and prove it with a trial run on your sample parts, with before/after measurement data.

Send Your Drawings & Tolerance RequirementsSee Automatic Straightening Machines