Healthy Marriages and Responsible Fatherhood Act of 2004

Healthy Marriages and Responsible Fatherhood Act of 2004 - Amends part A (Temporary Assistance for Needy Families) (TANF) of title IV of the Social Security Act to revise the TANF program. Repeals the bonus to States for reduction in illegitmacy ratio, replacing it with healthy marriage promotion grants.

Amends SSA title IV to add a new part C (Responible Fatherhood Program) under which the Secretary of Health and Human Services shall award grants to States to conduct demonstration programs promoting responsible fatherhood. Provides for: (1) a National Clearinghouse for responsible fatherhood programs to assist States and communities in efforts to promote and support marriage and responsible fatherhood; and (2) block grants to States to encourage media campaigns to produce broadcast advertisements that promote the formation and maintance of healthy two-parent married families, strengthen fragile families, and promote responsible fatherhood.

Adds funding under TANF for research, demonstrations, and technical assistance.

Rescinds funds for bonuses to reward high performance States.

Provides for extending: (1) the TANF program through March 15, 2005; and (2) the National Random Sample study through March 31, 2005.