The Swans claimed their first victory in 32 years over Newcastle as they took home all three points at St James' Park despite the hosts' late comeback.
Michu put Michael Laudrup's side ahead in the North East after 58 minutes before Jonathan de Guzman doubled the lead in the 87th minute.
Demba Ba nodded home in added on time, but the Swans held on for a thoroughly deserved victory in what was their second win on the road.
Michael Laudrup made two changes to the starting XI that drew at Southampton.
In went Itay Shechter for the injured Ki Sung-Yueng, and Nathan Dyer, who scored at his former club last time out.
Spaniard Chico Flores was included on the bench as he returned from injury, which meant Garry Monk continued to captain the side alongside Ashley Williams in the heart of defence.
Newcastle boss Alan Pardew was without Fabricio Coloccini, Jonas Gutierrez, Yohan Cabeye and Papiss Cisse as the hosts looked to bounce back from their 1-0 home defeat to West Ham last time out.
Newcastle: Tim Krul, Davide Santon, Danny Simpson (Gael Bigirimana, 74), Mike Williamson, Vurnon Anita, Hatem Ben Arfa, Demba Ba, Cheick Tiote, Steven Taylor (capt), Sammy Ameobi (Sylvain Marveaux, 80) Shane Ferguson (Shola Ameobi, ht).
Subs: Rob Elliot, Romain Amalfitano, James Tavernier, Mehdi Abeid.
Swans: Gerhard Tremmel, Angel Rangel, Garry Monk (capt), Ashley Williams, Ben Davies, Leon Britton, Jonathan de Guzman, Michu (Danny Graham, 82), Nathan Dyer (Wayne Routledge, 62), Pablo Hernandez, Itay Shechter (Kemy Agustien, 66).
Subs: David Cornell, Chico Flores, Luke Moore, Dwight Tiendalli
The first chance of the game went to the Swans, with Pablo Hernandez sliding through a pass for Nathan Dyer, who raced in one-on-one with keeper Tim Krul. But the winger failed to take his opportunity as he screwed his effort wide.
Another chance came after ten minutes, with Hernandez finding Michu on the halfway line, and when the striker switched play to Hernandez, the winger cut in and fired straight at Krul as the visitors continued to show their intent.
Newcastle replied via Hatem Ben Arfa, who directed his shot into the sidenetting before Demba Ba headed Ben Arfa's cross just wide.
Tremmel then had to be at his best to dive to his right to palm Ben Arfa's thunderous shot wide as the hosts upped the pressure.
The Swans responded though, with Ashley Williams' pass catching the Newcastle defence flatfooted, and when Shechter got onto the end of it, he was within sight of goal. But Krul was alert, racing out of his goal to deny the Israeli international.
Shechter was again in the centre of the action, this time he latched onto Michu's through pass, but again he was denied by Krul.
Michu then headed Hernandez's cross over after a swift counter attack as the clock ticked towards the half-time whistle.
Half-time: Swans 0 Newcastle 0
Pardew made a change at the break with Shola Ameobi replacing Shane Ferguson, and the striker made an early impression as his shot fell into the path of Ba, but he directed his effort just wide from ten yards out.
The Swans hit back via Shechter who fired over from 15 yards after Hernandez launched a counter attack, before the latter saw his curling shot pushed wide for a corner by Krul.
The visitors got their goal a minute later, as Krul's poor clearance dropped to Hernandez, who ran on and crossed to Michu, who headed past the Dutch keeper and into the corner of the net.
Michael Laudrup then replaced Dyer with Wayne Routledge while Kemy Agustien came on for Shechter.
The Swans could and should have doubled their lead with 15 minutes left as Routledge's superb pass sent Hernandez racing down the right, and the winger cut back to tee up Michu, but he scuffed his shot from ten yards.
It proved Michu's last involvement as he was replaced by Danny Graham for the last ten minutes.
And Graham had an instant impact as he played a big part in the second goal four minutes from time. Hernandez's sublime pass found the striker in space just inside the box, and when Krul parried his low shot, de Guzman fired in from an acute angle.
But with four minutes of added time to come, Newcastle ensured it was a tense finale as Ba headed in the rebounded after Sylvain Marveaux saw his effort cannon off the crossbar.
The Swans, though, held on for a thoroughly deserved victory.