C# - Gridview Paging - Actual Control On Page Remain Same (always Visible On Every Page)

<PagerStyle HorizontalAlign="Right" CssClass="paging"/>
<PagerTemplate>
<table width="100%">
<tr>
<td style="text-align:left; width:50%">
<asp:LinkButton ID="lnkPrv" Visible="false" CommandName="Page" CommandArgument="Prev" runat="server">Previous</asp:LinkButton>
</td>
<td style="text-align:right; width:50%;padding-left:50%;">
<asp:LinkButton ID="lnkNext" CommandName="Page" CommandArgument="Next" runat="server">Next</asp:LinkButton>
</td>
</tr>
</table>
</PagerTemplate>
Code behind is below
protected void gvProduct_PageIndexChanging(object sender, GridViewPageEventArgs e)
{
Literal1.Visible = gvProduct.PageIndex == 0;
LinkButton lnkPrv = (LinkButton)gvProduct.BottomPagerRow.FindControl("lnkPrv");
LinkButton lnkNext = (LinkButton)gvProduct.BottomPagerRow.FindControl("lnkNext");
lnkPrv.Visible = e.NewPageIndex > 0;
lnkNext.Visible = e.NewPageIndex < gvProduct.PageCount - 1;
gvProduct.PageIndex = e.NewPageIndex;
FillGrid();
}

The code does not give any error. I can see it set the visible property to true/false. But actual control on page remain same (always visible on every page).