Keyboard-friendly List Virtualization Behavior

proposals/0006-Keyboard-Friendly-Virtualization.md

@@ -0,0 +1,190 @@
+---
+title: "RFC0006: Keyboard-friendly List Virtualization Behavior"
+author: Nick Gerleman
+date: February 2021
+---
+
+# RFC0006: Keyboard-friendly List Virtualization Behavior
+
+## Summary
+
+VirtualizedList virtualizes away items based on proximity to the lists viewport,
+without consideration for other inputs such as focus or selection. This
+strategy limits the ability to correctly implement some common keyboard
+interactions. This especially impacts desktop platforms (react-native-web,
+react-native-windows, react-native-macos), but also impacts the tablet with
+keyboard form-factor on iPadOS/Android.
+
+This proposal outlines these issues, proposing a set of behavior changes and new
+APIs to address them. It does not address concrete implementation.
+
+## Basic example
+
+```jsx
+<FlatList
+ {...otherProps}
+ keepAreasRealized={{
+ focused: false,
+ home: [true, {windowSize: 1}],
+ }}
+/>
+```
+
+## Motivation
+
+Keyboard users expect to be able to navigate between between views inside of a
+list via tab-loop or arrow keys. A component with focus may move out of
+visibility by panning or scrolling a parent surface. The focused component may
+be virtualized away after leaving visibility.
+
+The removal of this native component disrupts state needed to move focus/selection.
+
+## Detailed design
+
+### Realization windows
+
+Focus may be moved by the native UI framework without waiting on a new component to be rendered. This forces us to
+prevent virtualization (keep realized) any components which focus may be moved
+to. We may see additional navigation after the initial focus change, unblocked
+on the rendering of new components. This necessitates a chain of additional
+realized components.
+
+Common keyboarding scenarios should ideally work by default, without having to
+change settings. Some of these scenarios include
+
+1. Navigating from one child component of a rendered item to another
+1. Arrowing between focused items
+1. Shifting focus from currently focused item via page up/down
+1. Shifting focus to first/last item via home/end keys
+
+`VirtualizedList` has enough internal knowledge to transparently support these
+scenarios. This can be accomplished by adding three **"realization windows"**:
+1. **"focused"** Realize cells around a cell with most recent focus. Can be
+tracked by listening to bubbling onFocusCapture in the default
+`CellRendererComponent`.
+1. **"home"** The area at the beginning of the list (for home key).
+ - Note that part of the top may already reamain realized, since the initial
+ render is retained. This may not be the case with non-default
+ `initialItemIndex` however, and the height may not correspond to layout
+ window.
+1. **"end"** The area at the end of the list (for end key).
+
+> Note that Apple devices have "fn + left" or "fn + right" which behave similarly
+> to home/end, but do not move selection in apps like Finder.
+
+The above scenarios are not exhaustive. It may be required to add additional
+APIs allowing external users greater control over realization behavior. These 
+ould potentially be exposed in the future as dynamic/user-controllable
+realization windows, or separate high-level APIs.
+
+### Batch rendering behavior
+
+After rendering a predefined number of initial items, `VirtualizedList` renders
+new items in batches. Batches may not render the full extent of items to
+realize, and the number of items to render per-batch is configurable.
+
+Cells in realization windows should be automatically rendered, even if not yet
+visible. This can be done during batch renders, giving priority to first render
+the window around visible content.
+
+### Endpoint-specific default behaviors
+
+VirtualizedList should be keyboard-friendly by default on desktop platforms as
+they are oriented towards usage of a physical keyboard. This additional
+realization is not free however, increasing memory usage to retain additional
+cells. This tradeoff may not make sense for mobile.
+
+This leads to desired behavior of:
+- **Keep FlatList focus-safe on desktop:** Realization windows needed for
+correct keyboard navigation should be enabled by default.
+- **Keep FlatList memory usage steady on mobile:** New realization windows
+are opt-in where not pay to play.
+
+The full matrix of behaviors is described in the *API Reference* below.
+
+Endpoint detection is generally performed via `Platform` APIs, such as
+`Platform.isTV()` or `Platform.isPad()`. This change would add a
+`Platform.isDesktop()` endpoint query to allow desktop-specific behavior.
+
+### New VirtualizedList props
+
+Properties should be added to VirtualizedList (and FlatList/SectionList) to
+allow optimizing for app-specific needs. This can be exposed as a
+`RealizationWindowConfig`, describing the size and enablement of predefined
+realization windows. This API could be expanded in the future to allow
+dynamically controlled realization behaviors.
+
+
+### API reference
+
+```tsx
+/**
+ * Allows enabling or disabling an area for realization, optionally overriding
+ * its window size.
+ */
+export type RealizationWindow =
+ | boolean
+ | [boolean, {windowSize?: number}];
+
+/**
+ * Determines what areas of the list to keep realized. Realizing extra windows
+ * may be required for correct behavior when focus is out of viewport, but may
+ * also increase memory usage.
+ */
+export type RealizationWindowConfig = {
+ /**
+ * Keeps the area around the currently focused item realized.
+ * - Enabled by default on all platforms
+ *
+ * To function with a non-default (CellRendererComponent)[
+ * https://reactnative.dev/docs/virtualizedlist#cellrenderercomponent],
+ * the `onFocusCapture` prop must be supported.
+ *
+ * Defaults to keeping the screen centered around the focused cell, along
+ * with a screen above and below realized.
+ */
+ focused?: RealizationWindow;
+
+ /**
+ * Keeps the beginning area of the list realized. Useful to allow instantly
+ * shifting focus to the first item (e.g. via Home key).
+ * - Disabled by default on all platforms (Should be enabled by default on
+ * desktop if FlatList begins transparently supporting home/end focus)
+ *
+ * Defaults to keeping a single screen at the beginning of the list realized
+ */
+ home?: RealizationWindow;
+
+ /**
+ * Keeps the end area of the list realized. Useful to allow instantly
+ * shifting focus to the first item (e.g. via End key).
+ * - Disabled by default on all platforms
+ * - Should be enabled by default on desktop if FlatList begins transparently
+ * supporting home/end focus.
+ *
+ * Defaults to keeping a single screen at the end of the list realized
+ */
+ end?: RealizationWindow;
+
+ // Potential to add additional props for different (or dynamic) realization
+ // areas
+}
+
+/**
+ * VirtualizedList (and FlatList/SectionList) component properties
+ */
+export type VirtualizedListProps = {
+ ...
+
+ /**
+ * Enables realization of different areas of the VirtualizedList
+ */
+ keepAreasRealized?: RealizationWindowConfig;
+}
+```
+
+## Drawbacks
+
+Apart from implementation complexity and risk, the greatest drawback to
+additional realization is memory consumption. This motivates configurability to
+mitigate impact.