Palberta began when all three members were studying at Bard College.[1] Their first full-length album, My Pal Berta, was released in 2013.[2] Palberta released their second full-length album in 2014 titled Shitheads In The Ditch.[3] In 2015, Palberta and the band No One and the Somebodies released a split album titled Chips For Dinner.[4] In 2017, Palberta released their third full-length, Bye Bye Berta.[5] In 2018, they released their fourth full-length album, Roach Goin' Down.[6][7] The trio's next album, Palberta5000, was released on January 22, 2021.[8][9]