No, your page filename does not need to be a .php ending. Your server does need to have php installed on it though. We recommend PHP 5.3 or higher.
Now go forth and make your websites great!