How can “relative frequency histogram” become a “probability density curve”?
$begingroup$
Suppose I've rolled two dice and took the sum, for $25$ times; then plotted the results on below histogram.
If I added up all the heights, I get the total $25$ as expected :
$$1+1+1+3+2+7+2+1+4+2+1=25$$
No issues so far.
Next, if I want a relative frequency histogram, I just need to scale the heights of the bars by $1/25$. Here if I add up all the heights, I will get $1$.
No issues here too.
In this video of khan academy and everywhere they say that the "area" under a relative frequency histogram equals 1. I don't know how this is true and it is throwing me off completely. I only see that the heights add up to 1. Maybe I'm missing something... Any help ?
EDIT : In above histogram the bin width is $1$, so it may not be a good example. Kindly also consider general histograms like below :
statistics probability-distributions
asked Dec 16 '18 at 14:28
rsadhvikarsadhvika
1,7101228
$endgroup$
|
show 4 more comments
$begingroup$
Suppose I've rolled two dice and took the sum, for $25$ times; then plotted the results on below histogram.
If I added up all the heights, I get the total $25$ as expected :
$$1+1+1+3+2+7+2+1+4+2+1=25$$
No issues so far.
Next, if I want a relative frequency histogram, I just need to scale the heights of the bars by $1/25$. Here if I add up all the heights, I will get $1$.
No issues here too.
In this video of khan academy and everywhere they say that the "area" under a relative frequency histogram equals 1. I don't know how this is true and it is throwing me off completely. I only see that the heights add up to 1. Maybe I'm missing something... Any help ?
EDIT : In above histogram the bin width is $1$, so it may not be a good example. Kindly also consider general histograms like below :
statistics probability-distributions
asked Dec 16 '18 at 14:28
rsadhvikarsadhvika
1,7101228
$endgroup$
1
$begingroup$
If you try to find the shaded area of your chart, you will find it is also $25$ since each bar is of width $1$. Scale the heights down and the area becomes $1$. But this could not be correctly correctly described as probability density as the possible values must be integers. On the other hand, if you had a random variable taking real values with density $frac1{25}$ on the interval $[1.5, 4.5)$, density $frac3{25}$ on $[4.5,5.5)$ etc. then the density graph would look very like the rescaled version of your chart
$endgroup$
– Henry
Dec 16 '18 at 14:36
$begingroup$
@Henry so when the width is $1$, I see thatarea= $sum$height*width$=1$. But how about when the width is not $1$ ?
$endgroup$
– rsadhvika
Dec 16 '18 at 14:40
$begingroup$
@Henry I've added another histogram to the post where the bin width is set to $5$. There if I scale the heights by $1/25$ and take the area, I get $5$, not $1$ ?
$endgroup$
– rsadhvika
Dec 16 '18 at 14:49
1
$begingroup$
Exactly when in the video do they say the area under a relative frequency histogram is $1$? Actually I see some steps in the video where they replace one histogram with another without explaining what they did to the vertical scale when it is obvious that they must have done something to the vertical scale.
$endgroup$
– David K
Dec 16 '18 at 15:24
1
$begingroup$
Now your second shaded area is $125$ so that is what you would need to scale down by to get something like a pdf: it will suggest a density of $frac{7}{125}$ on $[0,5)$, of $frac{15}{125}$ on $[5,10)$ and of $frac{3}{125}$ on $[10,15)$
$endgroup$
– Henry
Dec 16 '18 at 15:27
|
show 4 more comments
$begingroup$
Suppose I've rolled two dice and took the sum, for $25$ times; then plotted the results on below histogram.
If I added up all the heights, I get the total $25$ as expected :
$$1+1+1+3+2+7+2+1+4+2+1=25$$
No issues so far.
Next, if I want a relative frequency histogram, I just need to scale the heights of the bars by $1/25$. Here if I add up all the heights, I will get $1$.
No issues here too.
In this video of khan academy and everywhere they say that the "area" under a relative frequency histogram equals 1. I don't know how this is true and it is throwing me off completely. I only see that the heights add up to 1. Maybe I'm missing something... Any help ?
EDIT : In above histogram the bin width is $1$, so it may not be a good example. Kindly also consider general histograms like below :
statistics probability-distributions
asked Dec 16 '18 at 14:28
rsadhvikarsadhvika
1,7101228
$endgroup$
Suppose I've rolled two dice and took the sum, for $25$ times; then plotted the results on below histogram.
If I added up all the heights, I get the total $25$ as expected :
$$1+1+1+3+2+7+2+1+4+2+1=25$$
No issues so far.
Next, if I want a relative frequency histogram, I just need to scale the heights of the bars by $1/25$. Here if I add up all the heights, I will get $1$.
No issues here too.
In this video of khan academy and everywhere they say that the "area" under a relative frequency histogram equals 1. I don't know how this is true and it is throwing me off completely. I only see that the heights add up to 1. Maybe I'm missing something... Any help ?
EDIT : In above histogram the bin width is $1$, so it may not be a good example. Kindly also consider general histograms like below :
statistics probability-distributions
statistics probability-distributions
asked Dec 16 '18 at 14:28
rsadhvikarsadhvika
1,7101228
asked Dec 16 '18 at 14:28
rsadhvikarsadhvika
1,7101228
edited Dec 16 '18 at 14:47
rsadhvika
asked Dec 16 '18 at 14:28
rsadhvikarsadhvika
1,7101228
asked Dec 16 '18 at 14:28
rsadhvikarsadhvika
1,7101228
asked Dec 16 '18 at 14:28
rsadhvikarsadhvika
1,7101228
1,7101228
1
$begingroup$
If you try to find the shaded area of your chart, you will find it is also $25$ since each bar is of width $1$. Scale the heights down and the area becomes $1$. But this could not be correctly correctly described as probability density as the possible values must be integers. On the other hand, if you had a random variable taking real values with density $frac1{25}$ on the interval $[1.5, 4.5)$, density $frac3{25}$ on $[4.5,5.5)$ etc. then the density graph would look very like the rescaled version of your chart
$endgroup$
– Henry
Dec 16 '18 at 14:36
$begingroup$
@Henry so when the width is $1$, I see thatarea= $sum$height*width$=1$. But how about when the width is not $1$ ?
$endgroup$
– rsadhvika
Dec 16 '18 at 14:40
$begingroup$
@Henry I've added another histogram to the post where the bin width is set to $5$. There if I scale the heights by $1/25$ and take the area, I get $5$, not $1$ ?
$endgroup$
– rsadhvika
Dec 16 '18 at 14:49
1
$begingroup$
Exactly when in the video do they say the area under a relative frequency histogram is $1$? Actually I see some steps in the video where they replace one histogram with another without explaining what they did to the vertical scale when it is obvious that they must have done something to the vertical scale.
$endgroup$
– David K
Dec 16 '18 at 15:24
1
$begingroup$
Now your second shaded area is $125$ so that is what you would need to scale down by to get something like a pdf: it will suggest a density of $frac{7}{125}$ on $[0,5)$, of $frac{15}{125}$ on $[5,10)$ and of $frac{3}{125}$ on $[10,15)$
$endgroup$
– Henry
Dec 16 '18 at 15:27
|
show 4 more comments
1
$begingroup$
If you try to find the shaded area of your chart, you will find it is also $25$ since each bar is of width $1$. Scale the heights down and the area becomes $1$. But this could not be correctly correctly described as probability density as the possible values must be integers. On the other hand, if you had a random variable taking real values with density $frac1{25}$ on the interval $[1.5, 4.5)$, density $frac3{25}$ on $[4.5,5.5)$ etc. then the density graph would look very like the rescaled version of your chart
$endgroup$
– Henry
Dec 16 '18 at 14:36
$begingroup$
@Henry so when the width is $1$, I see thatarea= $sum$height*width$=1$. But how about when the width is not $1$ ?
$endgroup$
– rsadhvika
Dec 16 '18 at 14:40
$begingroup$
@Henry I've added another histogram to the post where the bin width is set to $5$. There if I scale the heights by $1/25$ and take the area, I get $5$, not $1$ ?
$endgroup$
– rsadhvika
Dec 16 '18 at 14:49
1
$begingroup$
Exactly when in the video do they say the area under a relative frequency histogram is $1$? Actually I see some steps in the video where they replace one histogram with another without explaining what they did to the vertical scale when it is obvious that they must have done something to the vertical scale.
$endgroup$
– David K
Dec 16 '18 at 15:24
1
$begingroup$
Now your second shaded area is $125$ so that is what you would need to scale down by to get something like a pdf: it will suggest a density of $frac{7}{125}$ on $[0,5)$, of $frac{15}{125}$ on $[5,10)$ and of $frac{3}{125}$ on $[10,15)$
$endgroup$
– Henry
Dec 16 '18 at 15:27
1
1
$begingroup$
If you try to find the shaded area of your chart, you will find it is also $25$ since each bar is of width $1$. Scale the heights down and the area becomes $1$. But this could not be correctly correctly described as probability density as the possible values must be integers. On the other hand, if you had a random variable taking real values with density $frac1{25}$ on the interval $[1.5, 4.5)$, density $frac3{25}$ on $[4.5,5.5)$ etc. then the density graph would look very like the rescaled version of your chart
$endgroup$
– Henry
Dec 16 '18 at 14:36
$begingroup$
If you try to find the shaded area of your chart, you will find it is also $25$ since each bar is of width $1$. Scale the heights down and the area becomes $1$. But this could not be correctly correctly described as probability density as the possible values must be integers. On the other hand, if you had a random variable taking real values with density $frac1{25}$ on the interval $[1.5, 4.5)$, density $frac3{25}$ on $[4.5,5.5)$ etc. then the density graph would look very like the rescaled version of your chart
$endgroup$
– Henry
Dec 16 '18 at 14:36
$begingroup$
@Henry so when the width is $1$, I see that
area = $sum$ height*width $=1$. But how about when the width is not $1$ ?$endgroup$
– rsadhvika
Dec 16 '18 at 14:40
$begingroup$
@Henry so when the width is $1$, I see that
area = $sum$ height*width $=1$. But how about when the width is not $1$ ?$endgroup$
– rsadhvika
Dec 16 '18 at 14:40
$begingroup$
@Henry I've added another histogram to the post where the bin width is set to $5$. There if I scale the heights by $1/25$ and take the area, I get $5$, not $1$ ?
$endgroup$
– rsadhvika
Dec 16 '18 at 14:49
$begingroup$
@Henry I've added another histogram to the post where the bin width is set to $5$. There if I scale the heights by $1/25$ and take the area, I get $5$, not $1$ ?
$endgroup$
– rsadhvika
Dec 16 '18 at 14:49
1
1
$begingroup$
Exactly when in the video do they say the area under a relative frequency histogram is $1$? Actually I see some steps in the video where they replace one histogram with another without explaining what they did to the vertical scale when it is obvious that they must have done something to the vertical scale.
$endgroup$
– David K
Dec 16 '18 at 15:24
$begingroup$
Exactly when in the video do they say the area under a relative frequency histogram is $1$? Actually I see some steps in the video where they replace one histogram with another without explaining what they did to the vertical scale when it is obvious that they must have done something to the vertical scale.
$endgroup$
– David K
Dec 16 '18 at 15:24
1
1
$begingroup$
Now your second shaded area is $125$ so that is what you would need to scale down by to get something like a pdf: it will suggest a density of $frac{7}{125}$ on $[0,5)$, of $frac{15}{125}$ on $[5,10)$ and of $frac{3}{125}$ on $[10,15)$
$endgroup$
– Henry
Dec 16 '18 at 15:27
$begingroup$
Now your second shaded area is $125$ so that is what you would need to scale down by to get something like a pdf: it will suggest a density of $frac{7}{125}$ on $[0,5)$, of $frac{15}{125}$ on $[5,10)$ and of $frac{3}{125}$ on $[10,15)$
$endgroup$
– Henry
Dec 16 '18 at 15:27
|
show 4 more comments
2 Answers
2
active
oldest
votes
$begingroup$
There seem to be two competing definitions of a relative frequency histogram, and some sources slip silently from one definition to the other.
This seems to be the case in the video you watched, in which at 3:32 we can see some kind of histogram being replaced by another kind of histogram with approximately the same area but approximately twice the total bar height.
You can define a kind of histogram in which by definition the sum of areas of the bars is $1,$ and the bars are scaled so that the area of each bar is the probability that a randomly chosen observation is in that bar.
Here are some course notes that define this kind of histogram as a scaled relative frequency histogram (while using the term relative frequency histogram for a chart in which the bar heights add up to $1$).
On the other hand, this answer on stats.SE
defines a relative frequency histogram as one in which the areas of the bars add up to $1$; in fact, that answer defines an ordinary frequency histogram as one in which the areas (not heights!) of the bars add up to the total number of observations.
And then you have sources such as this web page,
in which they explicitly say that relative frequency is the number of observations (of a particular subset of values) divided by the total number of observations,
and then claim that the area under this histogram is always $1,$
which is a dubious statement.
The figure actually drawn on that web page for the "relative" histogram has scaled the height of each bar to be twice the number of observations divided by the total number of observations in order to make the total area come out to $1.$
So you are justified in being a bit confused, because different sources use the same words for different things, and some sources even contradict themselves.
The key thing is to find a source of instruction that is clear and consistent about the meaning of each thing it shows you.
A good source, when it wants the total area of a histogram to be $1,$
will clearly define the construction of the histogram in a way that forces the total area of the bars to be $1.$
A good way to do this is to set the area of each bar to the fraction of the observations that are in the range of that bar along the horizontal axis.
If we do this, and if we make sure the bottom of each bar is exactly the part of the horizontal axis covered by its range, we get a histogram that resembles a density plot.
answered Dec 16 '18 at 15:57
David KDavid K
54.4k343120
$endgroup$
add a comment |
$begingroup$
I would like to try to answer the question somewhat broader, if I may. A histogram is an approximation to a probability measure. The broader question is: How should such an approximation look like? This does immediately answer the question about the construction of a histogram.
Which kind of probability measure do you want to approximate. Is it a discrete or a(n) (absolutely) continuous measure?
A discrete measure say on $mathbb{Z}$ has a probability mass function $f:mathbb{Z} rightarrow [0,1]$. In which case the probability of some event $A subseteq mathbb{Z}$ is defined as $$P(A) = sum_{a in A} f(a).$$
If you want to approximate such a measure that for instances assigns probabilities to categorial parameters or parameters on countable spaces, the way you describe above is the right way to go to approximate consistently the probability mass function $f$. The normalisation is indeed correct.
Moving on to the continuous case. Say, you want to approximate a probability measure on $mathbb{R}$. Given is now a probability density function $g$. An event $A := [a,b]$, $a leq b$ has probability:
$$P(A) = int_{a}^b g(x) mathrm{d}x$$
Note that $P(mathbb{R}) = 1$. Hence, if you want to approximate $g$, you need to make sure that $g$ integrates to $1$. One could for instance employ the following histogram:
$$hat{g}(x) = sum_{n= -infty}^infty a_nmathbf{1}_{(n,n+1]}(x),$$
where $mathbf{1}_{(n,n+1]}(x) = 1$, if $x in (n,n+1]$ and $0$ otherwise and $$a_n = frac{text{Number of data points in }(n,n+1]}{text{Total number of data points}}.$$
Obviously, this can be generalised to any partition of measurable sets of $mathbb{R}$, not just the set system ${(n, n+1] : n in mathbb{Z}}$.
Which normalisation is the right for you, depends only on your particular data set and the type of measure you want to approximate.
answered Dec 16 '18 at 15:48
JonasJonas
393211
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3042671%2fhow-can-relative-frequency-histogram-become-a-probability-density-curve%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
There seem to be two competing definitions of a relative frequency histogram, and some sources slip silently from one definition to the other.
This seems to be the case in the video you watched, in which at 3:32 we can see some kind of histogram being replaced by another kind of histogram with approximately the same area but approximately twice the total bar height.
You can define a kind of histogram in which by definition the sum of areas of the bars is $1,$ and the bars are scaled so that the area of each bar is the probability that a randomly chosen observation is in that bar.
Here are some course notes that define this kind of histogram as a scaled relative frequency histogram (while using the term relative frequency histogram for a chart in which the bar heights add up to $1$).
On the other hand, this answer on stats.SE
defines a relative frequency histogram as one in which the areas of the bars add up to $1$; in fact, that answer defines an ordinary frequency histogram as one in which the areas (not heights!) of the bars add up to the total number of observations.
And then you have sources such as this web page,
in which they explicitly say that relative frequency is the number of observations (of a particular subset of values) divided by the total number of observations,
and then claim that the area under this histogram is always $1,$
which is a dubious statement.
The figure actually drawn on that web page for the "relative" histogram has scaled the height of each bar to be twice the number of observations divided by the total number of observations in order to make the total area come out to $1.$
So you are justified in being a bit confused, because different sources use the same words for different things, and some sources even contradict themselves.
The key thing is to find a source of instruction that is clear and consistent about the meaning of each thing it shows you.
A good source, when it wants the total area of a histogram to be $1,$
will clearly define the construction of the histogram in a way that forces the total area of the bars to be $1.$
A good way to do this is to set the area of each bar to the fraction of the observations that are in the range of that bar along the horizontal axis.
If we do this, and if we make sure the bottom of each bar is exactly the part of the horizontal axis covered by its range, we get a histogram that resembles a density plot.
answered Dec 16 '18 at 15:57
David KDavid K
54.4k343120
$endgroup$
add a comment |
$begingroup$
There seem to be two competing definitions of a relative frequency histogram, and some sources slip silently from one definition to the other.
This seems to be the case in the video you watched, in which at 3:32 we can see some kind of histogram being replaced by another kind of histogram with approximately the same area but approximately twice the total bar height.
You can define a kind of histogram in which by definition the sum of areas of the bars is $1,$ and the bars are scaled so that the area of each bar is the probability that a randomly chosen observation is in that bar.
Here are some course notes that define this kind of histogram as a scaled relative frequency histogram (while using the term relative frequency histogram for a chart in which the bar heights add up to $1$).
On the other hand, this answer on stats.SE
defines a relative frequency histogram as one in which the areas of the bars add up to $1$; in fact, that answer defines an ordinary frequency histogram as one in which the areas (not heights!) of the bars add up to the total number of observations.
And then you have sources such as this web page,
in which they explicitly say that relative frequency is the number of observations (of a particular subset of values) divided by the total number of observations,
and then claim that the area under this histogram is always $1,$
which is a dubious statement.
The figure actually drawn on that web page for the "relative" histogram has scaled the height of each bar to be twice the number of observations divided by the total number of observations in order to make the total area come out to $1.$
So you are justified in being a bit confused, because different sources use the same words for different things, and some sources even contradict themselves.
The key thing is to find a source of instruction that is clear and consistent about the meaning of each thing it shows you.
A good source, when it wants the total area of a histogram to be $1,$
will clearly define the construction of the histogram in a way that forces the total area of the bars to be $1.$
A good way to do this is to set the area of each bar to the fraction of the observations that are in the range of that bar along the horizontal axis.
If we do this, and if we make sure the bottom of each bar is exactly the part of the horizontal axis covered by its range, we get a histogram that resembles a density plot.
answered Dec 16 '18 at 15:57
David KDavid K
54.4k343120
$endgroup$
add a comment |
$begingroup$
There seem to be two competing definitions of a relative frequency histogram, and some sources slip silently from one definition to the other.
This seems to be the case in the video you watched, in which at 3:32 we can see some kind of histogram being replaced by another kind of histogram with approximately the same area but approximately twice the total bar height.
You can define a kind of histogram in which by definition the sum of areas of the bars is $1,$ and the bars are scaled so that the area of each bar is the probability that a randomly chosen observation is in that bar.
Here are some course notes that define this kind of histogram as a scaled relative frequency histogram (while using the term relative frequency histogram for a chart in which the bar heights add up to $1$).
On the other hand, this answer on stats.SE
defines a relative frequency histogram as one in which the areas of the bars add up to $1$; in fact, that answer defines an ordinary frequency histogram as one in which the areas (not heights!) of the bars add up to the total number of observations.
And then you have sources such as this web page,
in which they explicitly say that relative frequency is the number of observations (of a particular subset of values) divided by the total number of observations,
and then claim that the area under this histogram is always $1,$
which is a dubious statement.
The figure actually drawn on that web page for the "relative" histogram has scaled the height of each bar to be twice the number of observations divided by the total number of observations in order to make the total area come out to $1.$
So you are justified in being a bit confused, because different sources use the same words for different things, and some sources even contradict themselves.
The key thing is to find a source of instruction that is clear and consistent about the meaning of each thing it shows you.
A good source, when it wants the total area of a histogram to be $1,$
will clearly define the construction of the histogram in a way that forces the total area of the bars to be $1.$
A good way to do this is to set the area of each bar to the fraction of the observations that are in the range of that bar along the horizontal axis.
If we do this, and if we make sure the bottom of each bar is exactly the part of the horizontal axis covered by its range, we get a histogram that resembles a density plot.
answered Dec 16 '18 at 15:57
David KDavid K
54.4k343120
$endgroup$
There seem to be two competing definitions of a relative frequency histogram, and some sources slip silently from one definition to the other.
This seems to be the case in the video you watched, in which at 3:32 we can see some kind of histogram being replaced by another kind of histogram with approximately the same area but approximately twice the total bar height.
You can define a kind of histogram in which by definition the sum of areas of the bars is $1,$ and the bars are scaled so that the area of each bar is the probability that a randomly chosen observation is in that bar.
Here are some course notes that define this kind of histogram as a scaled relative frequency histogram (while using the term relative frequency histogram for a chart in which the bar heights add up to $1$).
On the other hand, this answer on stats.SE
defines a relative frequency histogram as one in which the areas of the bars add up to $1$; in fact, that answer defines an ordinary frequency histogram as one in which the areas (not heights!) of the bars add up to the total number of observations.
And then you have sources such as this web page,
in which they explicitly say that relative frequency is the number of observations (of a particular subset of values) divided by the total number of observations,
and then claim that the area under this histogram is always $1,$
which is a dubious statement.
The figure actually drawn on that web page for the "relative" histogram has scaled the height of each bar to be twice the number of observations divided by the total number of observations in order to make the total area come out to $1.$
So you are justified in being a bit confused, because different sources use the same words for different things, and some sources even contradict themselves.
The key thing is to find a source of instruction that is clear and consistent about the meaning of each thing it shows you.
A good source, when it wants the total area of a histogram to be $1,$
will clearly define the construction of the histogram in a way that forces the total area of the bars to be $1.$
A good way to do this is to set the area of each bar to the fraction of the observations that are in the range of that bar along the horizontal axis.
If we do this, and if we make sure the bottom of each bar is exactly the part of the horizontal axis covered by its range, we get a histogram that resembles a density plot.
answered Dec 16 '18 at 15:57
David KDavid K
54.4k343120
answered Dec 16 '18 at 15:57
David KDavid K
54.4k343120
answered Dec 16 '18 at 15:57
David KDavid K
54.4k343120
answered Dec 16 '18 at 15:57
David KDavid K
54.4k343120
54.4k343120
add a comment |
add a comment |
$begingroup$
I would like to try to answer the question somewhat broader, if I may. A histogram is an approximation to a probability measure. The broader question is: How should such an approximation look like? This does immediately answer the question about the construction of a histogram.
Which kind of probability measure do you want to approximate. Is it a discrete or a(n) (absolutely) continuous measure?
A discrete measure say on $mathbb{Z}$ has a probability mass function $f:mathbb{Z} rightarrow [0,1]$. In which case the probability of some event $A subseteq mathbb{Z}$ is defined as $$P(A) = sum_{a in A} f(a).$$
If you want to approximate such a measure that for instances assigns probabilities to categorial parameters or parameters on countable spaces, the way you describe above is the right way to go to approximate consistently the probability mass function $f$. The normalisation is indeed correct.
Moving on to the continuous case. Say, you want to approximate a probability measure on $mathbb{R}$. Given is now a probability density function $g$. An event $A := [a,b]$, $a leq b$ has probability:
$$P(A) = int_{a}^b g(x) mathrm{d}x$$
Note that $P(mathbb{R}) = 1$. Hence, if you want to approximate $g$, you need to make sure that $g$ integrates to $1$. One could for instance employ the following histogram:
$$hat{g}(x) = sum_{n= -infty}^infty a_nmathbf{1}_{(n,n+1]}(x),$$
where $mathbf{1}_{(n,n+1]}(x) = 1$, if $x in (n,n+1]$ and $0$ otherwise and $$a_n = frac{text{Number of data points in }(n,n+1]}{text{Total number of data points}}.$$
Obviously, this can be generalised to any partition of measurable sets of $mathbb{R}$, not just the set system ${(n, n+1] : n in mathbb{Z}}$.
Which normalisation is the right for you, depends only on your particular data set and the type of measure you want to approximate.
answered Dec 16 '18 at 15:48
JonasJonas
393211
$endgroup$
add a comment |
$begingroup$
I would like to try to answer the question somewhat broader, if I may. A histogram is an approximation to a probability measure. The broader question is: How should such an approximation look like? This does immediately answer the question about the construction of a histogram.
Which kind of probability measure do you want to approximate. Is it a discrete or a(n) (absolutely) continuous measure?
A discrete measure say on $mathbb{Z}$ has a probability mass function $f:mathbb{Z} rightarrow [0,1]$. In which case the probability of some event $A subseteq mathbb{Z}$ is defined as $$P(A) = sum_{a in A} f(a).$$
If you want to approximate such a measure that for instances assigns probabilities to categorial parameters or parameters on countable spaces, the way you describe above is the right way to go to approximate consistently the probability mass function $f$. The normalisation is indeed correct.
Moving on to the continuous case. Say, you want to approximate a probability measure on $mathbb{R}$. Given is now a probability density function $g$. An event $A := [a,b]$, $a leq b$ has probability:
$$P(A) = int_{a}^b g(x) mathrm{d}x$$
Note that $P(mathbb{R}) = 1$. Hence, if you want to approximate $g$, you need to make sure that $g$ integrates to $1$. One could for instance employ the following histogram:
$$hat{g}(x) = sum_{n= -infty}^infty a_nmathbf{1}_{(n,n+1]}(x),$$
where $mathbf{1}_{(n,n+1]}(x) = 1$, if $x in (n,n+1]$ and $0$ otherwise and $$a_n = frac{text{Number of data points in }(n,n+1]}{text{Total number of data points}}.$$
Obviously, this can be generalised to any partition of measurable sets of $mathbb{R}$, not just the set system ${(n, n+1] : n in mathbb{Z}}$.
Which normalisation is the right for you, depends only on your particular data set and the type of measure you want to approximate.
answered Dec 16 '18 at 15:48
JonasJonas
393211
$endgroup$
add a comment |
$begingroup$
I would like to try to answer the question somewhat broader, if I may. A histogram is an approximation to a probability measure. The broader question is: How should such an approximation look like? This does immediately answer the question about the construction of a histogram.
Which kind of probability measure do you want to approximate. Is it a discrete or a(n) (absolutely) continuous measure?
A discrete measure say on $mathbb{Z}$ has a probability mass function $f:mathbb{Z} rightarrow [0,1]$. In which case the probability of some event $A subseteq mathbb{Z}$ is defined as $$P(A) = sum_{a in A} f(a).$$
If you want to approximate such a measure that for instances assigns probabilities to categorial parameters or parameters on countable spaces, the way you describe above is the right way to go to approximate consistently the probability mass function $f$. The normalisation is indeed correct.
Moving on to the continuous case. Say, you want to approximate a probability measure on $mathbb{R}$. Given is now a probability density function $g$. An event $A := [a,b]$, $a leq b$ has probability:
$$P(A) = int_{a}^b g(x) mathrm{d}x$$
Note that $P(mathbb{R}) = 1$. Hence, if you want to approximate $g$, you need to make sure that $g$ integrates to $1$. One could for instance employ the following histogram:
$$hat{g}(x) = sum_{n= -infty}^infty a_nmathbf{1}_{(n,n+1]}(x),$$
where $mathbf{1}_{(n,n+1]}(x) = 1$, if $x in (n,n+1]$ and $0$ otherwise and $$a_n = frac{text{Number of data points in }(n,n+1]}{text{Total number of data points}}.$$
Obviously, this can be generalised to any partition of measurable sets of $mathbb{R}$, not just the set system ${(n, n+1] : n in mathbb{Z}}$.
Which normalisation is the right for you, depends only on your particular data set and the type of measure you want to approximate.
answered Dec 16 '18 at 15:48
JonasJonas
393211
$endgroup$
I would like to try to answer the question somewhat broader, if I may. A histogram is an approximation to a probability measure. The broader question is: How should such an approximation look like? This does immediately answer the question about the construction of a histogram.
Which kind of probability measure do you want to approximate. Is it a discrete or a(n) (absolutely) continuous measure?
A discrete measure say on $mathbb{Z}$ has a probability mass function $f:mathbb{Z} rightarrow [0,1]$. In which case the probability of some event $A subseteq mathbb{Z}$ is defined as $$P(A) = sum_{a in A} f(a).$$
If you want to approximate such a measure that for instances assigns probabilities to categorial parameters or parameters on countable spaces, the way you describe above is the right way to go to approximate consistently the probability mass function $f$. The normalisation is indeed correct.
Moving on to the continuous case. Say, you want to approximate a probability measure on $mathbb{R}$. Given is now a probability density function $g$. An event $A := [a,b]$, $a leq b$ has probability:
$$P(A) = int_{a}^b g(x) mathrm{d}x$$
Note that $P(mathbb{R}) = 1$. Hence, if you want to approximate $g$, you need to make sure that $g$ integrates to $1$. One could for instance employ the following histogram:
$$hat{g}(x) = sum_{n= -infty}^infty a_nmathbf{1}_{(n,n+1]}(x),$$
where $mathbf{1}_{(n,n+1]}(x) = 1$, if $x in (n,n+1]$ and $0$ otherwise and $$a_n = frac{text{Number of data points in }(n,n+1]}{text{Total number of data points}}.$$
Obviously, this can be generalised to any partition of measurable sets of $mathbb{R}$, not just the set system ${(n, n+1] : n in mathbb{Z}}$.
Which normalisation is the right for you, depends only on your particular data set and the type of measure you want to approximate.
answered Dec 16 '18 at 15:48
JonasJonas
393211
edited Dec 16 '18 at 20:15
answered Dec 16 '18 at 15:48
JonasJonas
393211
answered Dec 16 '18 at 15:48
JonasJonas
393211
answered Dec 16 '18 at 15:48
JonasJonas
393211
393211
add a comment |
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3042671%2fhow-can-relative-frequency-histogram-become-a-probability-density-curve%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
$begingroup$
If you try to find the shaded area of your chart, you will find it is also $25$ since each bar is of width $1$. Scale the heights down and the area becomes $1$. But this could not be correctly correctly described as probability density as the possible values must be integers. On the other hand, if you had a random variable taking real values with density $frac1{25}$ on the interval $[1.5, 4.5)$, density $frac3{25}$ on $[4.5,5.5)$ etc. then the density graph would look very like the rescaled version of your chart
$endgroup$
– Henry
Dec 16 '18 at 14:36
$begingroup$
@Henry so when the width is $1$, I see that
area= $sum$height*width$=1$. But how about when the width is not $1$ ?$endgroup$
– rsadhvika
Dec 16 '18 at 14:40
$begingroup$
@Henry I've added another histogram to the post where the bin width is set to $5$. There if I scale the heights by $1/25$ and take the area, I get $5$, not $1$ ?
$endgroup$
– rsadhvika
Dec 16 '18 at 14:49
1
$begingroup$
Exactly when in the video do they say the area under a relative frequency histogram is $1$? Actually I see some steps in the video where they replace one histogram with another without explaining what they did to the vertical scale when it is obvious that they must have done something to the vertical scale.
$endgroup$
– David K
Dec 16 '18 at 15:24
1
$begingroup$
Now your second shaded area is $125$ so that is what you would need to scale down by to get something like a pdf: it will suggest a density of $frac{7}{125}$ on $[0,5)$, of $frac{15}{125}$ on $[5,10)$ and of $frac{3}{125}$ on $[10,15)$
$endgroup$
– Henry
Dec 16 '18 at 15:27