Celtic slipped to second in the Scottish Premiership after Kallum Higginbotham scored a late penalty for Kilmarnock who twice came from behind to seal a shock 2-2 draw at Rugby Park.

Celtic found themselves in front as early as the second minute as Leigh Griffiths finished off a Kris Commons free-kick.

Killie 'keeper Jamie MacDonald then made a host of saves as the Hoops threatened to run riot.

However, the hosts punished Celtic in the 44th minute when Josh Magennis levelled matters as Celtic conceded in the league for the first time since April 22.

The Glasgow giants regained the lead in style in the 55th minute as Israeli international Nir Bitton smashed a sensational strike past Jamie MacDonald from 25 yards.

With time running out Higginbotham dinked an 87th minute penalty past Craig Gordon to seal Kilmarnock's first point of the season.

"We had a lot of chances today and we were not clinical enough in our finishing and we also gave away way too many chances," a disappointed Celtic manager Ronny Deila said.

"Credit to Kilmarnock who put us under pressure but we need to do things differently and be more disciplined."

Kilmarock manager Gary Locke said he always believed his side could get something out of the game.

"I always felt we looked dangerous when we were going forward," Locke said.

"Jamie MacDonald made some great saves and we had a couple of chances and I'm delighted we took them."

Celtic are replaced at the top of the Scottish Premiership by newly-promoted Hearts who made it three wins out of three following their 2-0 victory over Motherwell thanks to a Gavin Reilly penalty and a Billy King strike.

Saidy Janko made his first start for Celtic at Rugby Park as one of three changes manager Ronny Deila made from the weekend win over Partick Thistle.

Celtic got off to a dream start as the alert Commons sent a free-kick over the static Kilmarnock defence and Griffiths got on the end of it to poke the ball past MacDonald.

The 'keeper had barely picked himself up before he had to get down low to smother the danger from a low drive from Commons before stopping a Rogic shot. Griffiths was next to see a swerving shot saved as the Celtic bombardment continued.

Kilmarnock had barely threatened before Magennis blew a golden chance to fire the home side level in the 35th minute. The Northern Ireland striker raced behind the Celtic defence to collect a clever through ball from Rory McKenzie but he blazed his effort high over.

Craig Gordon then instinctively stuck out a foot to keep out Lee Ashcroft's header as he connected with Steven Smith's free-kick.

Celtic hit back and Rogic saw his header hit the post, a follow-up strike saved by MacDonald before sending his third effort over the bar.

The Hoops were immediately punished for their missed chances as Magennis grabbed an equaliser in the 44th minute. The striker got in front of Efe Ambrose to stick out a leg and turn the ball past Gordon from Darryl Westlake's low cross.

Griffiths and Rogic both missed chances before Rogic teed up Bitton 25 yards out and he took a touch before unleashing an unstoppable swerving strike into the top corner to restore Celtic's lead.

Charlie Mulgrew had an effort ruled out for offside before Killie earned a late penalty. Emilio Izaguirre fouled Greg Kiltie in the box and Higginbotham cheekily chipped home the spot-kick.