Numbers are not our goal

Acts 2:46 & 47 -- So continuing daily with one accord in the temple, and breaking bread from house to house, they ate their food with gladness and simplicity of heart, praising God and having favor with all the people. And the Lord added to the church daily those who were being saved. --

The way the early church behaved and held themselves earned them favor with the people they came into contact with. They met with each other, taking meals happily. The LORD (v47) was adding to their number daily those who were being saved. This seems to tell us that we are not to worry about how many people gather with us, but to faithfully gather, do the work of his Kingdom together, enjoy the company of each other, and enjoy the presence of God. He will take care of how many people are drawn to us as we take care of drawing closer to Him.