!gdZddlZddlmZddlmZddlm Z GddZ e dk(rdgZ de vrd Z ejejj!e d f ej"e dffZejej&ej(d d dej*d ddd fj,Zej0gdgdgdgZej0gdgdgdgZej2eeZedejj!ej6 zz Zej2egdZedejj!ej6 zzZe eeZeejAedejCdddeejAyyy)zQ Created on Sun Nov 14 08:21:41 2010 Author: josef-pktd License: BSD (3-clause) N)pca) LeaveOneOutc2eZdZdZdZddZdZd dZdZy) FactorModelUnivariatea  Todo: check treatment of const, make it optional ? add hasconst (0 or 1), needed when selecting nfact+hasconst options are arguments in calc_factors, should be more public instead cross-validation is slow for large number of observations cltj||_tj||_y)N)npasarrayendogexog)selfr r s f/var/www/dash_apps/app1/venv/lib/python3.12/site-packages/statsmodels/sandbox/datarich/factormodels.py__init__zFactorModelUnivariate.__init__s"ZZ& JJt$ Nc| |j}ntj|}t||d\}}}}||_|r$t j |d|_d|_n||_d|_||_ ||_ y)zget factor decomposition of exogenous variables This uses principal component analysis to obtain the factors. The number of factors kept is the maximum that will be considered in the regression. N)keepdim normalizeT)prependr) r rr r exog_reducedsm add_constantfactorshasconstevalsevecs)r xraddconstxredfactrrs r calc_factorsz"FactorModelUnivariate.calc_factors sv 9 A 1 A$'7a$H dE5  ??4>DLDMDLDM  rct|ds|jtj|j|j ddd|dzfj S)Nfactors_wconstr)hasattrr rOLSr rfit)r nfacts r fit_fixed_nfactz%FactorModelUnivariate.fit_fixed_nfact7sLt-.    vvdjj$,,q%'z":;??AArc <t|ds|j|j}||jjd|z }||zdkr t dt |d}|j}g}td||zD] }|jddd|f}tj||j} |s|tt|}d} |D]l\} } tj|| || ddfj} | || | jj| j || ddfz dzz } nnt"j$} |j'|| j(| j*| j,| gt#j.|x|_}t"j2t#j4|ddddfd t#j6|dddfd t#j4|ddd fd f|_y) aWestimate the model and selection criteria for up to maxfact factors The selection criteria that are calculated are AIC, BIC, and R2_adj. and additionally cross-validation prediction error sum of squares if `skip_crossval` is false. Cross-validation is not used by default because it can be time consuming to calculate. By default the cross-validation method is Leave-one-out on the full dataset. A different cross-validation sample can be specified as an argument to cv_iter. Results are attached in `results_find_nfact` rNrzFnothing to do, number of factors (incl. constant) should be at least 1 @r)r#r rrshape ValueErrorminr rangerr$r%rlenmodelpredictparamsrnanappendaicbic rsquared_adjarrayresults_find_nfactr_argminargmax best_nfact)r maxfact skip_crossvalcv_iterry0resultskrresprederr2inidxoutidxres_l1os r fit_find_nfactz$FactorModelUnivariate.fit_find_nfact<s$tY'    == ?ll((+h6G H  !-. .gr" ZZq'(*+ NA<<"1"%D&&T"&&(C!?)#b'2G%,\ME6 ffRYU1W >BBDGF!(!6!6w~~tFSTH~!V"WY[!\\H\ 66 NNAsww1A1A8L M3 N6-/HHW,=='%%71QqS5>!!WYYwqt}Q/!12rczt|ds|j|j}d}|dz }|ddt|jzzz }ddlm}djd }d gd gd zz}t| }|||d|}|dz }|dz }|d|jzz }|dz }|dz }|dz }|dz }|S)zprovides a summary for the selection of the number of factors Returns ------- sumstr : str summary of the results for selecting the number of factors r<z, Best result for k, by AIC, BIC, R2_adj, L1Oz z%5d %4d %6d %5dr) SimpleTablezk, AIC, BIC, R2_adj, L1Oz, z%6dz%10.3f) data_fmtsN)txt_fmtz" PCA regression on simulated data,z+ DGP: 2 factors and 4 explanatory variables z) Notes: k is number of components of PCA,z& constant is added additionallyz- k=0 means regression on constant onlyz? L1O: sum of squared prediction errors for leave-one-out) r#rLr<tupler@statsmodels.iolib.tablerOsplitdict__str__)r rEsumstrrOheaders numformattxt_fmt1tabls r summary_find_nfactz(FactorModelUnivariate.summary_find_nfact~st12    !))FF -"3eDOO6L"LLL7,2248Gxjl* I.7GT8D<<EE$''CC@@GGYY r)NrT)NTN) __name__ __module__ __qualname____doc__rr r'rLr^rr rrs#% .B @2D#rr__main__ri)sizerPr-)?rgr*r*)r*r*rgrg)@r+rgr*)皙?rhrgr*)r*r*g?riri)rgrgrgzwith cross validation - slowerF)rArBrC)"rbnumpyrstatsmodels.apiapirstatsmodels.sandbox.toolsr#statsmodels.sandbox.tools.cross_valrrr_examplesnobsc_randomnormalonesf0repeateyearangeTf2xcoefr;dotx0r.ytruerDmodprintr^rLrcrr rs); PPf zsHH} UU299##$q#2GBGGT!H4EE F%%  &"&&)Aa01dd1CCDFF"((00023"((33245RVVB  c"))"""111r,' S))u{{);; ;#B+ c$$&' ./ 4udK c$$&''r