State Fiscal Relief Act of 2004

State Fiscal Relief Act of 2004 - Amends the Jobs and Growth Tax Relief Reconciliation Act of 2003 to extend the temporary freeze of the Federal medical assistance percentage (FMAP) under title XIX (Medicaid) of the Social Security Act (SSA) for certain States (continuing the FY 2003 FMAP through each calendar quarter of FY 2004, and the FY 2004 FMAP for each calendar quarter of FY 2005 if the FY 2005 FMAP would otherwise be less than the FY 2004 FMAP).

Amends the Jobs and Growth Tax Relief Reconciliation Act of 2003 to increase the FMAP: (1) by 2.95 percentage points for the last two calendar quarters of FY 2003 and the first three calendar quarters of FY 2004; and (2) by 1.26 percentage points for the last calendar quarter of FY 2004 and each calendar quarter of FY 2005.

Increases by 5.9 percent the ceiling on Medicaid payments to specified territories for the last two calendar quarters of FY 2003 and the first three calendar quarters of FY 2004. Increases such ceiling by 2.52 percent for the last calendar quarter of FY 2004 and each calendar quarter of FY 2005.

Amends SSA title XIX, with respect to the transitional increased Federal matching rate for increased administrative costs, to require a specified minimum increase for administrative expenditures that would not be incurred but for enactment of the Medicare Prescription Drug, Improvement, and Modernization Act of 2003. Sets $1.2 billion as the cap on the total amount of additional Federal funds expended as a result of this Act with respect to such administrative expenditures between October 1, 2004, and the later of either: (1) April 1, 2006; or (2) the end of the first fiscal year quarter that begins on or after the date on which benefits are first provided under the voluntary prescription drug benefit program under SSA title XVIII (Medicare) part D.