Elysian Fields in Hoboken, New Jersey is believed to be the site of the first organized baseball game, giving Hoboken a strong claim to be the birthplace of baseball.
In 1845, Knickerbocker Club of New York City began using Elysian Fields in Hoboken to play baseball due to the lack of suitable grounds across the Hudson River in Manhattan. On June 19, 1846, the Knickerbockers led by Alexander Cartwright played the New York Nine on these grounds in the first organized game between two clubs. By the 1850's, several Manhattan-based member clubs of the National Association of Base Ball Players were using the grounds as their home field.
http://www.pittsfield.com/baseball.htm