Uncertainty: Difference between revisions

From Objective Mathematics
Jump to navigation Jump to search
(Created page with "== How do we measure continuous quantities? == First, set up some sort of "triangulation" of the space in which the continuous quantity can take values. For example, a ruler is a "triangulated" line. Typically some sort of quantitative system is chosen to keep track of the cells; e.g. for a ruler we count how many ticks there are. A measurement of a continuous quantity is simply an identification of which one of those intervals the continuous quantity lies inside. It's...")
 
Line 5: Line 5:


== How do we apply functions to continuous quantities? ==
== How do we apply functions to continuous quantities? ==
=== Motivating example ===
Let's suppose that we are measuring lengths with a meter stick, which goes down to the nearest 2 millimeters. That is, the ticks on the stick appear at 0mm, 2mm, 4mm, 6mm, etc.  
Let's suppose that we are measuring lengths with a meter stick, which goes down to the nearest 2 millimeters. That is, the ticks on the stick appear at 0mm, 2mm, 4mm, 6mm, etc.  


Line 27: Line 29:


Let the grid on one axis consist of intervals <math>[n \pi / 6, (n+1)\pi / 6]</math>, let the grid on the other axis consist of intervals <math>[0.1n, 0.1(n+1)]</math> where <math>n\in \mathbb{Z}</math>, and let the continuum function <math>h(x) = \cos(x)</math>. Then <math>h</math> sends the interval <math>[0, \pi/6]</math> to the interval <math display="block">[\sqrt{3}/2,1] = [0.866\cdots, 1] \subset [0.8, 0.9] \cup [0.9, 1.0]</math>So after applying  <math>h</math> to a length in that internal, we will get a length which is in the interval <math>[0.9, 1.0]</math> with probability <math display="inline">\frac{1}{10 - 5 \sqrt{3}} \approx 0.75 </math>, and in the interval <math>[0.8, 0.9]</math> with probability <math display="inline">\frac{9 - 5 \sqrt{3} }{10 - 5 \sqrt{3}} \approx 0.25 </math>.
Let the grid on one axis consist of intervals <math>[n \pi / 6, (n+1)\pi / 6]</math>, let the grid on the other axis consist of intervals <math>[0.1n, 0.1(n+1)]</math> where <math>n\in \mathbb{Z}</math>, and let the continuum function <math>h(x) = \cos(x)</math>. Then <math>h</math> sends the interval <math>[0, \pi/6]</math> to the interval <math display="block">[\sqrt{3}/2,1] = [0.866\cdots, 1] \subset [0.8, 0.9] \cup [0.9, 1.0]</math>So after applying  <math>h</math> to a length in that internal, we will get a length which is in the interval <math>[0.9, 1.0]</math> with probability <math display="inline">\frac{1}{10 - 5 \sqrt{3}} \approx 0.75 </math>, and in the interval <math>[0.8, 0.9]</math> with probability <math display="inline">\frac{9 - 5 \sqrt{3} }{10 - 5 \sqrt{3}} \approx 0.25 </math>.
=== General formulation ===
Let <math>f : \mathbb{R} \rightarrow \mathbb{R}</math> be a continuous function (which is also a continuum function), and suppose we have a grid consisting of intervals <math>[a_n, b_n]</math> where <math>a_n, b_n</math> are real numbers such that <math>b_n = a_{n + 1}</math>. We refer to the ordered set of these intervals as "the grid" and denote it as <math>\Gamma</math>.
'''Definition'''. A ''probability distribution'' on a set <math>S</math> is a function <math>p: S \rightarrow [0,1]</math>, such that <math>p_s = 0 </math> for all but finitely many <math>s \in S</math>, and <math>\sum_{s\in S} p_s = 1</math>. Let <math>\text{Prob}(S)</math> denote the set of probability distributions on <math>S</math>.
Since <math>f</math> is continuous, it sends intervals to intervals. If <math>I = [a,b]</math> is any interval, define its volume as <math>\text{Vol}(I):= b - a</math>. Then <math>f</math> induces a function <math>\widetilde{f} : \Gamma \rightarrow \text{Prob}(\Gamma)  </math>, where <math display="block">\widetilde{f}(n)_m := \frac{\text{Vol}(f([a_n, b_n]) \cap [a_m,b_m] ) }{\text{Vol}(f([a_n,b_n]) )}</math>
The interpretation of <math>\widetilde{f}</math> is completely clear: If the function <math>f</math> is applied to a quantity that was measured as being in the grid interval <math>[a_n, b_n]</math>, then the probability that the resulting quantity will be measured as being in the grid interval <math>[a_m, b_m]</math> is <math>\widetilde{f}(n)_m</math>.

Revision as of 20:31, 22 October 2024

How do we measure continuous quantities?

First, set up some sort of "triangulation" of the space in which the continuous quantity can take values. For example, a ruler is a "triangulated" line. Typically some sort of quantitative system is chosen to keep track of the cells; e.g. for a ruler we count how many ticks there are.

A measurement of a continuous quantity is simply an identification of which one of those intervals the continuous quantity lies inside. It's a declaration "this quantity lives inside this interval."

How do we apply functions to continuous quantities?

Motivating example

Let's suppose that we are measuring lengths with a meter stick, which goes down to the nearest 2 millimeters. That is, the ticks on the stick appear at 0mm, 2mm, 4mm, 6mm, etc.

Suppose that we measure a certain length, then, by some process, we double the length. That is, we apply the "continuum" function Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f(x) = 2x} .

That is what Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} does to length itself, but what does Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} do to measurements of length?

Let Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x} denote a length lying somewhere in the range Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [2k-2, 2k]} millimeters (a minimal interval on the meter stick). Then Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f(x) = 2x} lies somewhere in the range Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [4k-4, 4k] = [4k - 4, 4k -2] \cup [4k - 2, 4k]} , which is the union of two minimal intervals of the meter stick. So maybe we should say that induces a multi-valued function?

Hmm, but what would be the induced function of Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle g(x) = 1.5x} ? It would send the interval Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [2k-2, 2k]} to the interval Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [3k-3, 3k]} , which is not necessarily a union of two minimal intervals.

I think it would be best to treat the induced function in a probabilistic manner: If the length Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x} is equally likely to be anywhere in the range Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [2k-2, 2k]} , then

  • Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle 2x} it has a 1/2 chance of being in Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [4k - 4, 4k -2]} , and a 1/2 chance of being in Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [4k - 2, 4k]} .
  • Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle 3x} has,
    • if Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle k} is even, a 2/3 chance of being in Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [3k - 2, 3k]} , and a 1/3 chance of being in Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [3k - 4, 3k - 2]} .
    • if Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle k} is odd, a 2/3 chance of being in Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [3(k+1) - 6, 3(k+1)-4]} , and a 1/3 chance of being in Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [3(k+1) - 4, 3(k+1)-2]} .

The general principle is that you have some sort of probability measure on the triangulation, and then you push it forward to another one.

The "problem" with this is that the true probability distributions are "continuum," as the following example demonstrates.

Let the grid on one axis consist of intervals Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [n \pi / 6, (n+1)\pi / 6]} , let the grid on the other axis consist of intervals Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [0.1n, 0.1(n+1)]} where Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle n\in \mathbb{Z}} , and let the continuum function Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle h(x) = \cos(x)} . Then Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle h} sends the interval Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [0, \pi/6]} to the interval Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [\sqrt{3}/2,1] = [0.866\cdots, 1] \subset [0.8, 0.9] \cup [0.9, 1.0]} So after applying Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle h} to a length in that internal, we will get a length which is in the interval Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [0.9, 1.0]} with probability Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\textstyle \frac{1}{10 - 5 \sqrt{3}} \approx 0.75 } , and in the interval Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [0.8, 0.9]} with probability Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\textstyle \frac{9 - 5 \sqrt{3} }{10 - 5 \sqrt{3}} \approx 0.25 } .

General formulation

Let Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f : \mathbb{R} \rightarrow \mathbb{R}} be a continuous function (which is also a continuum function), and suppose we have a grid consisting of intervals Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle [a_n, b_n]} where Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_n, b_n} are real numbers such that Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle b_n = a_{n + 1}} . We refer to the ordered set of these intervals as "the grid" and denote it as Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \Gamma} .

Definition. A probability distribution on a set Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle S} is a function Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p: S \rightarrow [0,1]} , such that Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p_s = 0 } for all but finitely many Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle s \in S} , and Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \sum_{s\in S} p_s = 1} . Let Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \text{Prob}(S)} denote the set of probability distributions on Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle S} .

Since Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} is continuous, it sends intervals to intervals. If Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle I = [a,b]} is any interval, define its volume as Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \text{Vol}(I):= b - a} . Then induces a function , where

The interpretation of is completely clear: If the function is applied to a quantity that was measured as being in the grid interval , then the probability that the resulting quantity will be measured as being in the grid interval is .