This is a note for the following paper:
F. Cucker, S. Smale, On the mathematical foundations of learning, Bulletin of The American Mathematical Society, 39(1), 1-49, 2001.
Page 6, Remark 2
In addition,
, the error above specializes to the error mentioned in that discussion, and the regression function
of
coincides with
execpt for a set of measure zero in
.
Note:
For a given , we have
For the regression function, we may have
where for
and
for
. Hence, we find that
which coincides with .
Page 10, line 6
Thus,
is a vector space of dimension
Note:
Obviously, the conclusion is correct for . We employ second mathematical induction to illustrate the result. Suppose the result is correct for
to
, let us verify the case
. For the additional dimension, we can let
. Then, the number of possible ways should be
Written the above formula in a concise manner, we obtain
These calculations verify the desired conclusions.
Page 21, The proof of Proposition 7
Proposition 7 follows from Lemma 8 by applying the same argument used to prove Theorem B from Proposition 3
Note:
Let and consider
such that the disks
centered at
and with radius
cover
. Then for every
, we have
. Employing Lemma 8, we find that
Proposition 7 has been proved.
Page 27, Proof of Theorem 3
First note that by replacing
by
we can reduce the problem in both part (1) and (2) to the case
Note:
Since is equivalent to
with
. From the proof, especially the formula of
, we know that
holds true when . Replacing
with
, we obtain
Finally, we arrive at
with . Similarly, we can deduce the estimation (2). Here, the result (1) is slightly different from the statment in Theorem 3. It may be a small mistake.