Sometimes the best solution is the simplest.

Fixed the paging issue by just having paging done in the current pane.
The other option was to see swaymsg to relaunch

sway/scripts/fzf-pass

@@ -37,8 +37,7 @@ case "$RESP" in
             && ydotool type \"\$(pass get_pass $PASSFILE)\""
 		;;
 	Page)
-        "$HOME/.config/sway/scripts/tty-popup" info \
-            bash -c "pass \"${PASSFILE}\" | LESS=R less" 
+    pass "$PASSFILE" | LESS=R less
 		;;
 	*)
 		exit 1