The “pod Panienką” shrine was built in 1908 on the initiative of Józefa Naglik, the wife of the mayor Jędrzej Naglik. She was probably also the donor of the statue of Virgin Mary Immaculate, which was made in Tirol. In addition to the shrine, Józefa Naglik bought an adjacent meadow with a view to using it for religious purposes. Around 1910, the statue in the shrine was exchanged for a similar one given by Teresa Reczko which originally stood in the side altar of the parish church. The shrine is used for holy masses which are celebrated there three times a year: on 3 May, 15 August and the first Sunday in October, and are  traditionally preceded by long processions from the church to the shrine. The masses and processions were forbidden during the Nazi occupation and in the Stalinist period, and then  briefly resumed in the mid 1950s. Now they have been held regularly since the 1990s. In 2000, the statue of Our Lady in the shrine was decorated with episcopal crowns. The act was performed by Cardinal Franciszek Macharski, who had served as a vicar in Kozy between 1950 and 1956.  For that occasion,  the shine also received a wooden canopy and a few rows of seats outside for worshippers. In 2008, a bell tower was built next to the shrine to commemorate its centenary. The shrine itself and its surroundings, as well as the figure of the Virgin Mary, are reminiscent of the Marian place of worship at Lourdes in France. Next to the shrine is a spring of water drawn from a nearby forest well. Above the door of the shrine is a stone tablet which originally bore the inscription “God save Poland”which was changed in the 1940s to:“Do not abandon us, Mother”.