SIMETRIUM .COM 100 = 99.9996?
SERIES · DRAFTING AND CAD
EN|36 languages
What you see
LUPREC and DIMDEC decide how many decimal places to show. The coordinates themselves are stored with 15–16 significant digits.
What is there
A rounded number hides an error of up to half the last digit: at 0 decimal places — up to 0.5 mm.
On the plate — a dimension display and a decimal-places drum. The drum clicks from 0 to 8 decimal places: first «100», then «99.9996». Below is a microscope over a corner of the boundary: at each click it magnifies ten times more, until a gap opens up between the ends of the segments.
Quantity passport · drafting and CAD · display precision

Unit precision

LUPREC · DIMDEC · AUPREC · rounding error ≤ ½ · 10⁻ᵖ · HPGAPTOL

A cover gasket 100 × 60 with 5 × 45° chamfers is redrawn from someone else’s drawing. The dimensions there are in whole millimetres: the chamfers are labelled «7» and «12». The designer enters the segments from these numbers, AutoCAD shows them with zero decimal places, and everything looks exact. The hatch will not fill: «Valid hatch boundary not found». At the end of the boundary there is a 0.45 mm gap, and at LUPREC 0 the properties show it as «0».

Unit precision is the number of decimal places the program displays on screen. It does not change the geometry: coordinates are stored in double precision, about 15 significant digits. Rounding hides the error but does not remove it. If the numbers for construction are taken from the screen rather than through object snaps, the error of each number passes into the drawing. The errors add up along the boundary, and the last point does not arrive back at the first.

Quantityp — number of decimal places; rounding error ε, mm
Error bound|ε| ≤ 0.5 · 10⁻ᵖ: at 0 decimal places — 0.5 mm, at 2 — 0.005, at 4 — 0.00005
VariablesLUPREC — linear units, 0–8; DIMDEC — dimension text; AUPREC — angles
StorageIEEE 754 double precision: about 15–16 significant digits, independent of LUPREC
Closurethe hatch accepts the boundary if the gap ≤ HPGAPTOL; default 0 — an exact joint is needed
To boundary and hatch AutoCAD tip
01 · Definition

The displayed number and the real one

To round to p decimal places means to replace a number with the nearest multiple of 10⁻ᵖ. The difference between them is at most half a step: 0.5 · 10⁻ᵖ. At LUPREC 4 a 99.9996 segment is shown as 99.9996, at LUPREC 3 as 100.000, at LUPREC 0 as 100. All three entries are one and the same segment, only shown with a different number of decimal places.

The danger comes when the displayed number becomes the input for the next construction. Every number typed in from the screen carries an error of up to half a step. In a closed boundary of n sides the errors add up as vectors, and the end drifts away from the start. The worst case is n · 0.5 · 10⁻ᵖ, usually less, about 0.3 · 10⁻ᵖ · √n. Object snaps to endpoints and intersections take coordinates from memory, where the number is stored in full, and no error arises.

x — true value · p — decimal places · ε — rounding error · n — sides in the boundary · g — closure gap
Interactive · one number, nine entries

How a segment is displayed

The rows are LUPREC from 0 to 8. On the right is what the screen shows; the bar is the hidden error, logarithmic scale. Choose a segment.

Reference · where the error shows and where it does not
0.5 mmvisible to the eye on screen at normal zoom; LUPREC 0 hides it 0.005 mmthe hatch no longer fills; visible only when zoomed in to a single corner 0.0004 mm«100 = 99.9996»: a gap from PDF import or scaling 10⁻¹² mmdouble precision noise at coordinates around 100 — harmless
Viewing
LUPREC 4 at work, 8 when checking
Drawing
with object snaps, not numbers from the screen
Labelling
DIMDEC per drawing: 0 or 1
Interactive · boundary, dimensions, hatch and zoom

Five parts, three variables, one gap

The main action is the «Start drawing» button. The part is drawn segment by segment from the numbers of another drawing, on which the dimensions are rounded to DIMDEC. Then dimensions are placed, and at the chosen LUPREC everything adds up. Then a hatch is tried: if the gap at the end of the boundary is larger than HPGAPTOL, the fill leaks. The microscope magnifies the corner in tenfold steps until the gap becomes visible, and the control panel shows it with eight decimal places. Below the scene you choose the part: a gasket with chamfers, a 30° gusset, a tapered key, an access panel with a gable or a base plate from PDF. There you also choose where the numbers come from (DIMDEC of someone else’s drawing or object snaps), which LUPREC is set on screen, and HPGAPTOL. The «Show all digits» button switches on LUPREC 8 and reveals the truth.

left: control panel — numbers entered, perimeter on screen and true, gapright: endpoint properties, microscope, three lamps
Main action
Rewind0.0 s
Part
Numbers from
LUPREC on screen
HPGAPTOL
Gap on screen
—
—
True gap
—
—
Perimeter
—
—
Hatching
—
—

—

Gap and precision of the source numbers
all five parts, both scales logarithmic
Lines are parts, dots are DIMDEC 0, 1, 2 and 4. Each decimal place reduces the gap about tenfold. The dashed line is HPGAPTOL: below it the hatch fills.
What the screen sees
true gap and gap shown at LUPREC
Red is the true gap, teal is what the properties will show. If there is no teal, the screen shows zero although the gap is there.
Error of each side
entered minus true, mm
Bars are the side errors, the band is ±0.5 · 10⁻ᵖ. Each error is small, but together they carry the end of the boundary away.
02 · Conversion
NUMBER · DECIMAL PLACES · SIDES IN BOUNDARY
ON SCREEN
Choosing in a minute
1Divide the part tolerance by ten: for ±0.1 mm a precision of 0.01 is needed.2As many decimal places as make 0.5 · 10⁻ᵖ smaller than that: here p = 2.3Set LUPREC 2 places higher — 4: you will see if someone typed numbers in by hand.4Before hatching — LUPREC 8 and LIST at the boundary endpoint.

Angles are rounded too: AUPREC 0 shows 30° for a line at 29.9996°. On a 100 mm side this shifts the end by 0.0007 mm — enough for the boundary not to close.

DIMRND rounds dimension text to a step: at 0.5 a 99.7 dimension is labelled 99.5. This is a presentation rule, not construction precision, and the two must not be confused.

pstep|ε| maxgap, 8 sideswhere
03 · Orders of magnitude
ERROR HIDDEN BY THE NUMBER OF DECIMAL PLACES, LOGARITHMIC SCALE

04 · Measuring instruments
Command: LISTLINE Layer: 0from point, X=0.00000000 Y=0.00000000to point, X=99.99960000Length = 99.99960000
LIST and properties
They show coordinates and length with the current LUPREC. At LUPREC 8 eight decimal places are visible — enough to find any manual error.
ZOOM · 0.01 mm window
zoom to corner
A 0.001 mm gap can be seen if the screen window is narrowed to hundredths of a millimetre. AutoCAD allows this: zoom works over 10 orders of magnitude.
boundary not closed
hatch as a test
HATCH with a picked internal point looks for a closed boundary. At HPGAPTOL 0 it finds one only with an exact joint and marks the break with a red circle.
100measured 99.9996
dimension with DIMDEC 0
A dimension always shows the measured value rounded to DIMDEC. If the dimension text has been overwritten by hand, the difference from the geometry cannot be seen at all.
05 · Writing rules
Correct
draw with object snaps to endpoints and intersections
LUPREC 4 at work, 8 when checking the boundary
DIMDEC according to drawing presentation, independent of LUPREC
after PDF import — OVERKILL and a check of joints
a 5 × 45° chamfer — with the CHAMFER command, not a «7» segment
Incorrect
typing in numbers read off the screen
LUPREC 0, «so the digits don’t get in the way»
overwritten dimension text instead of the true value
HPGAPTOL 5, so that the hatch «finally fills»
assuming that 100 on screen is exactly 100
Series · Drafting and CAD
desk tips for every sheet
AutoCAD · precision and closure
Command:
Unit precisionLUPREC · DIMDEC · HPGAPTOL
Lit.
shown
actual
У
100
99.9996
SIMETRIUM · «Drafting and CAD» seriesLUPREC hides the error but does not remove it
06 · Neighbouring units
07 · Historical section
nearestx|ε| ≤ ½ step
rounding
Metrological note

The number of digits in an entry is a statement of precision: «100» means «from 99.5 to 100.5», «100.00» means «from 99.995 to 100.005». In metrology a result is written exactly this way: the last digit is the first uncertain one. In CAD the rule is the reverse: the geometry is exact, and the entry is coarser than it. That is why an entry must never be fed back into construction.

The errors of the boundary sides are independent and uniformly distributed within ±½ step. Their sum along the boundary behaves like a random walk: the mean gap grows as the square root of the number of sides. A hexagon at DIMDEC 2 leaves a gap of about 0.005 mm, and that is enough for the hatch not to find the boundary.

gap g ≈ 0.3·10⁻ᵖ·√n
random walk
Catalogue of quantities
the whole index →
the foundation · 7 units

The seven SI base units

on the sheet’s topic · drafting and CAD
The index lab: a glass of cabbage juice, a burner, a glass of water on a cold plate and a gear train
Index · all quantities on one page
The lab at the entrance to the index

A drop of acid changes the colour of the juice, salt colours the flame, water freezes at a tap. Below them are all Simetrium sheets, by discipline and alphabetically.

Open the index →
08 · Your language
every link is a real page in that locale

Read it in your own language

translated and checkeddraft translationqueued
Share this pagethe link leads to this page