This text comes from The Book of Scottish Song, edited by Alexander Whitelaw, a historical songbook transcribed on Wikisource and reproduced from the pinned revision linked below.
Had I a cave on some wild distant shore,
Where the winds howl to the waves' dashing roar:
There would I weep my woes,
There seek my lost repose,
Till grief my eyes should close,
Ne'er to wake more.
Falsest of womankind, canst thou declare,
All thy fond-plighted vows—fleeting as air!
To thy new lover hie,
Laugh o'er thy perjury,
Then in thy bosom try
What peace is there!