Former Foreign Minister Alexander Downer has lashed Prime Minister Anthony Albanese for his handling of Australia's foreign policy interests as his diplomatic visit to China comes to a close.