Congressional Access to the CMS Chief Actuary Act of 2004

Congressional Access to the CMS Chief Actuary Act of 2004 - Amends title XI of the Social Security Act, as amended by the Medicare Prescription Drug, Improvement, and Modernization Act of 2003, to require the Chief Actuary in exercising the duties of his or her office to provide the committees of jurisdiction of Congress with independent counsel and technical assistance with respect to the programs under SSA titles XVIII (Medicare), XIX (Medicaid), and XXI (Children's Health Insurance).

Authorizes the Chief Actuary to provide Congress directly with reports, comments on, and estimates of, the financial effects of potential legislation, and other actuarial information related to such programs.

Prohibits any officer or agency of the United States from requiring the Chief Actuary to submit such reports, comments, estimates, or other information to any U.S. officer or agency for approval, comments, or review before submitting them to Congress.