Harold has a big, fat, plastic bat. We've been using it to hit balls around the backyard and even at the park.
He also has a toy Spiderman baseball glove, which I've been using when pitching to him, though the glove is small kid size.
On Sunday, I went to Sports Basement to buy a glove for myself; I couldn't find the one I've had for a long time. I want us to start playing catch in addition to just him hitting the ball with the bat. While there, I also picked up a wiffle ball set, with a bag full of spare balls.
If he starts to get into baseball, I guess that could be ok with me.