Please paste the below code at the starting of your .htaccess.

RewriteEngine On
RewriteCond %{REQUEST_FILENAME} !-f
RewriteRule ^([^\.]+)$ $1.ical [NC,L]

See if it resolves the problem.

Thank You