THE UNIVERSITY OF HONG KONGDEPARTMENT OF STATISTICS AND ACTUARIAL SCIENCESTAT 6014/7614 Advanced Statistical LearningAssignment 3 Due Date: December 5, 20191. The dataset ozone.csv records the level of atmospheric ozone concentration and twometeorological variables at different locations in the Los Angeles basin in 1976. The response,referred to as ozone (O3), is the logarithm of the daily maximum of the hourly-average ozoneconcentrations (ppm) in Upland, California. The other two variables are temperature in qF(temp) and inversion base height in feet (ibh). The first few lines of the dataset is shownbelow:> head(ozone)(a) Use R to determine the univariate kernel density estimate for the response variables O3using Sheather and Jones’ plug-in rule for bandwidth selection. How are the ozone levels(logarithm transformed) distributed without taking account of the other variables?(b) Use R to fit a generalized additive model with O3 as response and temp, ibh as additiveexplanatory variables. You may choose a response distribution based on the result obtainedin part (a). Write down the equation of the fitted model with necessary details includingdefinitions of all involved coefficients (if applicable) and regression/smoothing terms.(c) Construct partial prediction plots for the model fitted in part (b).(d) Is there any linear relationship between O3 and the explanatory variables revealed from thefit plots obtained in part (c)? Use R to perform Chi-square test to confirm.(e) Use R to refine the model based on the result in part (d). Write down the final fitted model.(f) From the results obtained above, how does the GAM compare to a GLIM for this dataset?Explain briefly. (You don’t need to fit the GLIM.) 19/20, 1st termP. 22. To fit a nonparametric model ܻ based on a data set, thesmoothing spline estimator is obtained by minimizingwith respect to the regression function ݉, where is the smoothing parameter and.(a) Is it reasonable to replace the second order derivative ݉′′ by the first order derivative ݉′in the objective function ? Explain briefly.(b) What solution for will be obtained for → ∞ ?(c) Below are three smoothing splines fitted for a given data set, for which three values ofthe smoothing parameter,0.0007, 0.02, 0.5, are used. Identify the value of ߣ usedfor each estimate.(d) Suppose that a sample of size is observed as and asmoothing spline is being fitted. The following is a dialogue between two students.Alice: “A cubic function can be uniquely defined by 4 points. Since the fitted regressionfunction must be a natural cubic spline, the resulting fit should be a cubic functionperfectly interpolating the data.”Bob: “How about the value of ? The choice of the smoothing parameter代写STAT 6014、代做STATISTICS、R编程设计 ߣ wouldaffect the fitted model. I don’t think the fitted regression function must be aperfect interpolation.”Briefly comment on their claims.Estimate A Estimate B Estimate C 19/20, 1st termP. 33. The dataset typhoon.csv records the annual numbers of typhoon signal no. 8 issued inHong Kong from 1956 to 2018, and the first few lines are shown below:> head(typhoon)(a) Use R to fit a three-state Poisson-HMM to the annual numbers of typhoon signals.(b) Draw a state transition diagram to show the architecture of the fitted HMM, includingestimates of the model parameters.(c) Use Viterbi decoding to determine the most likely state path for 2014 to 2018.(d) Use posterior decoding to determine the most likely states for 2014 to 2018.(e) Based on the state for year 2018 obtained in part (d), estimate the expected number oftyphoon signal no. 8 that will be issued in 2019.4. The ASIA data set is a small synthetic data set from Lauritzen and Spiegelhalter (1988) thattries to implement a diagnostic model for lung diseases (tuberculosis, lung cancer, orbronchitis) after a visit to Asia. The original data set contains the following variables:A visit to Asia recently (no / yes)S smoker (no / yes)T has tuberculosis (no / yes)L has lung cancer (no / yes)B has bronchitis (no / yes)X positive chest X-ray results (no / yes)D shortness-of-breath (dyspnea) symptom (no / yes)Since the results of a single chest X-ray do not discriminate between lung cancer andtuberculosis, a deterministic variable E is added and determined from the values in variablesT and L:E tuberculosis or lung cancer (no / yes) 19/20, 1st termP. 4The first few lines of the data set asia.csv are shown below:> head(asia) A S T L B E X D1 no yes no no yes no no yes2 no yes no no no no no no3 yes no yes no no yes yes yes4 no no no no yes no no yes5 no no no no no no no yes6 no yes no no no no no yes(a) Use R package bnlearn to fit a Bayesian network by hill-climbing algorithm.(b) Write down the joint probability as a product of conditional probabilities according to thenetwork structure determined in part (a).(c) Based on what was suggested from the network structure, state “True” or “False” or“Uncertain” for each of the following statements.(i) Node L d-separates node S and node X.(ii) A recent visit to Asia affects the chance of the presence of dyspnea.(iii) For a smoker with positive chest X-ray results, whether he/she had recently visitAsia does not affect his/her risk of having bronchitis.(d) Write down the Markov blanket of node E.(e) According to the fitted Bayesian network, how likely is that a non-smoker with positivechest X-ray results would be suffering from tuberculosis? 转自：http://www.6daixie.com/contents/18/4469.html