Psalms 137:4

4.How shall we sing, etc. The Psalmist puts a lofty and magnanimous answer into the mouth of the Lord’s people to their insolent reproach, which is this, that they abstained from their songs, as from their legal sacrifices, because the land where they now were was polluted. The Chaldeans thought the Jews were bound down permanently to this place of their exile; the Psalmist, when he calls it a foreign land, suggests that it was but the place of their temporary stay. But the main idea is, that Chaldea was not worthy of the honor of having God’s praises sung in it. No doubt the children of God wherever they have lived have always been strangers and foreigners in the world, but the land of Canaan was the sacred rest provided for them, and the Psalmist well describes them as being foreigners and sojourners when they were in other climes. He would in this way have them to be always ready and prepared for their return, tacitly enforcing what Jeremiah had prophesied, when, in order to prevent them from forgetting their native country, he had definitely foretold the time during which their exile should last, (Jeremiah 25:11; Jeremiah 29:10.) He would in the meantime animate them to constancy, and have them not to coalesce with the Babylonians through motives of fear. In our own day under the Papacy, great as the danger may be to which the faithful expose themselves by not conforming to the example around them, the Holy Spirit makes use of such a barrier as this to separate them from sinful compliances. (183) To those, whether Frenchmen, Englishmen, or Italians, who love and practice the true religion, even their native country is a foreign clime when they live under that tyranny. And yet there is a distinction between us and God’s ancient people, for at that time the worship of God was confined to one place, but now he has his Temple wherever two or three are met together in Christ’s name, if they separate themselves from all idolatrous profession, and maintain purity of divine worship. The Psalmist by the language which he employs would by no means put down every attempt on their part to celebrate God’s praises. He rather exhorts them under their affliction to wait with patience till the liberty of publicly worshipping God was restored, saying’ upon the matter — We have been bereft of our Temple and sacrifices, we wander as exiles in a polluted land, and what remains but that in remembrance of our outcast state we should sigh and groan for the promised deliverance.