This was the first Catholic "church" in Norwalk. Mass was held in the upstairs of this building until the small community had enough money to build the church pictured below.
Today, this shrine is in the same place the former St. Peter's was. It is owned by St. Paul's Catholic church here in Norwalk and is never really open to the public. Why? who knows... There are masses there every Wednesday evening in the summers, however.