Place potatoes in a large pot and add cold salted water to cover them.
Bring to a boil over medium heat.
Cook partially covered until potatoes are tender 10-12 minutes.
Drain water and keep potatoes in pan.
Remove from heat and allow potatoes to dry a bit.
Mash potatoes and add buttermilk to make a smooth puree.
Season with salt and pepper.
Stir in egg and olive oil.
Spread potatoes on chicken mixture.
Set dish on a baking sheet and bake until potatoes and filling are heated through. Top will turn golden brown about 25-35 minutes.