2. Central Limit Theorem:Greenberg and Webster (1983)
Z1,Z2,· · ·,Znare mutually indelendently distributed with meanµand variance Σi.
Then, we have the following result:
√1 n
∑n i=1
(Zi−µ) −→ N(0,Σ), where
Σ = lim
n→∞
1 n
∑n i=1
Σi
. The distribution ofZiis not assumed.
3. DefineZi = xi0ui. Then,Σi =Var(Zi)=σ2x0ixi.
4. Σis defined as:
Σ = lim
n→∞
1 n
∑n i=1
σ2x0ixi
= σ2lim
n→∞
(1 nX0X
)
=σ2Mxx,
where
X =
x1 x2 ...
xn
5. Applying Central Limit Theorem (Greenberg and Webster (1983), we obtain the following:
√1 n
∑n i=1
x0iui = 1
√nX0u−→ N(0, σ2Mxx). On the other hand, from ˆβn =β+(X0X)−1X0u, we can rewrite as:
√n( ˆβ−β)=(1
X0X)−1 1
√ X0u.
Var((1
nX0X)−1 1
√nX0u )
=E((1
nX0X)−1 1
√nX0u((1
nX0X)−1 1
√nX0u)0)
=(1
nX0X)−1(1
nX0E(uu0)X)(1
nX0X)−1
=σ2(1
nX0X)−1
−→ σ2M−xx1.
Therefore,
√n( ˆβ−β) −→ N(0, σ2Mxx−1)
=⇒Asymptotic normality (漸近的正規性) of OLSE The distribution ofui is not assumed.
12 Instrumental Variable (
操作変数法)
12.1 Measurement Error (
測定誤差)
Errors in Variables
1. True regression model:
y= X˜β+u 2. Observed variable:
X = X˜ +V
V: is called themeasurement error (測定誤差or観測誤差).
3. For the elements which do not include measurement errors in X, the corre- sponding elements inV are zeros.
4. Regression using observed variable:
y= Xβ+(u−Vβ) OLS ofβis:
βˆ =(X0X)−1X0y=β+(X0X)−1X0(u−Vβ)
5. Assumptions:
(a) The measurement error inXis uncorrelated with ˜Xin the limit. i.e., plim(1
nX˜0V)
=0.
Therefore, we obtain the following:
plim(1 nX0X)
=plim(1 nX˜0X˜)
+plim(1 nV0V)
= Σ + Ω
(b) uis not correlated withV. uis not correlated with ˜X.
That is,
plim(1 nV0u)
=0, plim(1 nX˜0u)
=0.
6. OLSE ofβis:
βˆ =β+(X0X)−1X0(u−Vβ)=β+(X0X)−1( ˜X+V)0(u−Vβ). Therefore, we obtain the following:
plim ˆβ=β−(Σ + Ω)−1Ωβ
7. Example: The Case of Two Variables:
The regression model is given by:
yt =α+βx˜t+ut, xt = x˜t+vt. Under the above model,
Σ =plim(1 nX˜0X˜)
= plim
1 1
n
∑
˜ xi
1 n
∑
˜ xi 1
n
∑
˜ x2i
=
(1 µ
µ µ2+σ2 )
, whereµandσ2represent the mean and variance of ˜xi.
Ω =plim(1 nV0V)
=plim
(0 0
0 1
n
∑ v2i
)
=
(0 0
0 σ2v
) .
Therefore, plim
(αˆ βˆ )
= (α
β )
−
((1 µ
µ µ2+σ2 )
+
(0 0
0 σ2v
))−1(0 0 0 σ2v
) (α β )
= (α
β )
− 1 σ2+σ2v
(−µσ2vβ σ2vβ
)
Now we focus onβ.
βˆ is not consistent. because of:
plim( ˆβ)=β− σ2vβ σ2+σ2v
= β
1+σ2v/σ2 < β
12.2 Instrumental Variable (IV) Method (
操作変数法or IV
法)
Instrumental Variable (IV)
1. Consider the regression model:y= Xβ+uandu∼N(0, σ2In).
In the case of E(X0u), 0, OLSE ofβis inconsistent.
2. Proof:
βˆ =β+(1
nX0X)−11
nX0u −→ β+ M−xx1Mxu, where
1
nX0X −→ Mxx, 1
nX0u −→ Mxu ,0 3. Find theZwhich satisfies 1
nZ0u −→ Mzu= 0.
MultiplyingZ0on both sides of the regression model: y=Xβ+u, Z0y=Z0Xβ+Z0u
Dividingnon both sides of the above equation, we take plim on both sides.
Then, we obtain the following:
plim (1
nZ0y )
= plim (1
nZ0X )
β+plim (1
nZ0u )
=plim (1
nZ0X )
β.
Accordingly, we obtain:
β= (
plim (1
nZ0X ))−1
plim (1
nZ0y )
. Therefore, we consider the following estimator:
βIV =(Z0X)−1Z0y,
which is taken as an estimator ofβ.
=⇒ Instrumental Variable Method (操作変数法or IV法) 4. Assume the followings:
1
nZ0X −→ Mzx, 1
nZ0Z −→ Mzz, 1
nZ0u −→ 0 5. Asymptotic Distribution ofβIV:
βIV =(Z0X)−1Z0y= (Z0X)−1Z0(Xβ+u)= β+(Z0X)−1Z0u, which is rewritten as:
√n(βIV −β)=(1
nZ0X)−1( 1
√nZ0u)
Applying the Central Limit Theorem to( 1
√nZ0u)
, we have the following result:
√1
nZ0u −→ N(0, σ2Mzz).
Therefore,
√n(βIV −β)=(1
nZ0X)−1( 1
√nZ0u)
−→ N(0, σ2Mzx−1MzzMzx0 −1)
=⇒ Consistency and Asymptotic Normality 6. The variance ofβIV is given by:
V(βIV)= s2(Z0X)−1Z0Z(X0Z)−1, where
s2 = (y−XβIV)0(y−XβIV) n−k .
12.3 Two-Stage Least Squares Method (2
段階最小二乗法, 2SLS or TSLS)
1. Regression Model:
y= Xβ+u, u∼N(0, σ2I),
In the case of E(X0u), 0, OLSE is not consistent.
2. Find the variableZ which satisfies 1
nZ0u −→ Mzu=0.
3. UseZ = Xˆ for the instrumental variable.
Xˆ is the predicted value which regresses X on the other exogenous variables, sayW.
That is, consider the following regression model:
X= W B+V.
EstimateBby OLS.
Then, we obtain the prediction:
Xˆ =WBˆ, where ˆB=(W0W)−1W0X.
Or, equivalently,
Xˆ = W(W0W)−1W0X. Xˆ is used for the instrumental variable ofX.
4. The IV method is rewritten as:
βIV =( ˆX0X)−1Xˆ0y= (X0W(W0W)−1W0X)−1X0W(W0W)−1W0y. Furthermore,βIV is written as follows:
β =β+ 0 0 −1 0 −1 0 0 −1 0 .
Therefore, we obtain the following expression:
√n(βIV −β)=((1
nX0W)(1
nW0W)−1(1
nXW0)0)−1(1
nX0W)(1
nW0W)−1( 1
√nW0u)
−→ N(
0, σ2(MxwMww−1M0xw)−1) .
5. Clearly, there is no correlation betweenW anduat least in the limit, i.e., plim(1
nW0u)
=0.
6. Remark:
Xˆ0X= X0W(W0W)−1W0X = X0W(W0W)−1W0W(W0W)−1W0X= Xˆ0Xˆ. Therefore,
βIV =( ˆX0X)−1Xˆ0y= ( ˆX0X)ˆ −1Xˆ0y,
which implies the OLS estimator ofβin the regression model: y= Xˆβ+uand u∼ N(0, σ2In).
Example:
yt =αxt+βzt+ut, ut ∼(0, σ2). Suppose that xtis correlated withut butzt is not correlated withut.
• 1st Step:
Estimate the following regression model:
xt = γwt +δzt +· · ·+vt, by OLS. =⇒ Obtain ˆxtthrough OLS.
• 2nd Step:
Estimate the following regression model:
yt =αxˆt +βzt+ut, by OLS. =⇒ αivandβiv
Note as follows. Estimate the following regression model:
zt =γ2wt +δ2zt+· · ·+v2t, by OLS.
=⇒ γˆ2 = 0, ˆδ2 =1, and the other coefficient estimates are zeros. i.e., ˆzt =zt.
Eviews Command:
tsls y x z @ w z ...