L'Angleterre and L'Allemagne (not sure of spellings) would both be feminine, yes?

They would indeed! And both correctly spelled to boot. But watch out for "Canada" - it ends in "a" but it's masculine: "le Canada", "au Canada".