This is a note for the following paper:
F. Cucker, S. Smale, On the mathematical foundations of learning, Bulletin of The American Mathematical Society, 39(1), 1-49, 2001.
Page 6, Remark 2
In addition, , the error above specializes to the error mentioned in that discussion, and the regression function of coincides with execpt for a set of measure zero in .
Note:
For a given , we have
For the regression function, we may have
where for and for . Hence, we find that
which coincides with .
Page 10, line 6
Thus, is a vector space of dimension
Note:
Obviously, the conclusion is correct for . We employ second mathematical induction to illustrate the result. Suppose the result is correct for to , let us verify the case . For the additional dimension, we can let . Then, the number of possible ways should be
Written the above formula in a concise manner, we obtain
These calculations verify the desired conclusions.
Page 21, The proof of Proposition 7
Proposition 7 follows from Lemma 8 by applying the same argument used to prove Theorem B from Proposition 3
Note:
Let and consider such that the disks centered at and with radius cover . Then for every , we have . Employing Lemma 8, we find that
Proposition 7 has been proved.
Page 27, Proof of Theorem 3
First note that by replacing by we can reduce the problem in both part (1) and (2) to the case
Note:
Since is equivalent to with . From the proof, especially the formula of , we know that
holds true when . Replacing with , we obtain
Finally, we arrive at
with . Similarly, we can deduce the estimation (2). Here, the result (1) is slightly different from the statment in Theorem 3. It may be a small mistake.