Mathematics
Grade 9
15 min
Precision
Precision
Tutorial Preview
1
Introduction & Learning Objectives
Learning Objectives
Define precision and distinguish it from accuracy.
Determine the number of significant figures in a given measurement.
Apply the rules of precision for adding and subtracting measurements.
Apply the rules of precision for multiplying and dividing measurements.
Calculate the greatest possible error (GPE) for a given measurement.
Express a measurement's range using tolerance notation (e.g., x ± GPE).
Ever measured a piece of wood for a project, cut it, and found it was just a tiny bit too short? 📏 Let's explore why that 'tiny bit' matters!
This tutorial introduces the concept of precision, which is all about the level of detail in a measurement. You will learn how to handle calculations with measured numbers so that your answers aren&#...
2
Key Concepts & Vocabulary
TermDefinitionExample
PrecisionA measure of how close a series of measurements of the same quantity are to one another. It reflects the level of detail of the measurement, indicated by the number of decimal places or significant figures.Measuring a pencil three times and getting 15.21 cm, 15.22 cm, and 15.21 cm is highly precise. A measurement of 15.2 cm is less precise than 15.21 cm.
AccuracyA measure of how close a measurement is to the true or accepted value. A measurement can be precise without being accurate.If the true length of a pencil is 16.00 cm, the precise measurements of 15.21 cm and 15.22 cm are not accurate.
Significant Figures (Significant Digits)The digits in a number that are reliable and contribute to its precision. This includes all non-zero digits, zeros between non-z...
3
Core Formulas
Addition & Subtraction Precision Rule
Round the result to the same number of decimal places as the measurement with the *least* number of decimal places.
When adding or subtracting measurements, the precision of the result is limited by the least precise measurement. For example, you can't get an answer precise to the hundredths place if one of your starting numbers was only precise to the tenths place.
Multiplication & Division Precision Rule
Round the result to the same number of significant figures as the measurement with the *least* number of significant figures.
When multiplying or dividing, the number of reliable digits in your answer is limited by the measurement with the fewest reliable digits (significant figures).
Greatest Possible Error (GPE) Form...
4 more steps in this tutorial
Sign up free to access the complete tutorial with worked examples and practice.
Sign Up Free to ContinueSample Practice Questions
Challenging
A box is measured to have a length of 12.1 cm, a width of 8.2 cm, and a height of 5.15 cm. What is the volume of the box, reported to the correct number of significant figures?
A.511.453 cm³
B.511.5 cm³
C.511 cm³
D.510 cm³
Challenging
The area of a square was calculated and correctly reported as 25 m². Which of the following could have been the measured side length of the square?
A.5 m
B.5.0 m
C.5.00 m
D.4.98 m
Challenging
You find the average speed of a car that travels 150.5 km and then 85 km in a total of 3.0 hours. What is the average speed with correct precision?
A.78.5 km/h
B.78.7 km/h
C.79 km/h
D.80 km/h
Want to practice and check your answers?
Sign up to access all questions with instant feedback, explanations, and progress tracking.
Start Practicing Free