The above derivation does not guarantee that J(and hence H+) is nonsingular. However, I can prove directly
that (9) defines a nonsingular matrix J using the following
theorem:
Theorem 3.1 (Sherman-Morrison-Woodbury)
Suppose
is
nonsingular and
are such that
is nonsingular. Then
B=A+UVT
is nonsingular and
(Note: The rank of UVT is easily shown to be p or less.)