The environment and grounds within St Francis Xavier Primary School provide wonderful opportunities for physical activity, including ovals, basketball courts, tennis courts, paddocks, the gymnasium, playgrounds and gardens.

St Francis Xavier Primary School is involved with outside organisations such as Kelly Sports for after-school activities, and School Sport Victoria so children can excel in a variety of sports at a regional level, and higher. Local organisations, such as Ballarat Badminton, and Hockey, Basketball and Cricket Victoria provide a variety of in-school clinics.