GREEN BAY, Wis. (WFRV)-- The man accused of setting fire to the Planned Parenthood in Grand Chute told a federal judge his guilty of the crime.

Francis Grady, 50,  is charged with arson of a building and intentionally damaging a property used to provide reproductive health services.

Grady told a federal judge he is guilty of the crime, and attempted to fire his court-appointed lawyer.

"I pleaded guilty upstairs. The lawyer started talking in front of the judge, I told my lawyer he's fired," Grady told reporters as he was taken away by authorities.

Grady also told reporters he set fire to the planned parenthood and tried to justify why he did it, his reason, because they "kill babies there."

"I am guilty," said Grady, "there was no bomb, it was gasoline."

Grady's court appointed lawyer tom Philip said Grady cannot fire him and intends to represent him at his next hearing.

"This is just the first appearance, so I know very little about him yet, and the case is just brand new, so i'll learn more as the case goes by," said Philip, "the court would have to relieve me before I could actually be fired from the case."

Grady was taken into custody Monday night after surveillance footage identified him.

The home-made explosive device went off near a window sill outside the grand chute office on Sunday. A fire from the explosion caused minor damage.

Since it was an initial hearing Grady's guilty plea was not formally entered. He is being held in the Outagamie county jail and is scheduled to appear in court again on April 19.