Proposed resolution:

This wording is relative to N3936.

1. Change Table 53 — "Reference modifications" in [meta.trans.ref] as indicated:

   Table 53 — Reference modifications

   Template	Comments
   …
   template <class T> struct add_lvalue_reference;	If T names an object or function typea referenceable type then the member typedef type shall name T&; otherwise, if T names a type "rvalue reference to T1" then the member typedef type shall name T1&; otherwise, type shall name T. [Note: This rule reflects the semantics of reference collapsing ([dcl.ref]). — end note]
   template <class T> struct add_rvalue_reference;	If T names an object or function typea referenceable type then the member typedef type shall name T&&; otherwise, type shall name T. [Note: This rule reflects the semantics of reference collapsing ([dcl.ref]). For example, when a type T names a type T1&, the type add_rvalue_reference_t<T> is not an rvalue reference. — end note]

2. Change Table 56 — "Pointer modifications" in [meta.trans.ptr] as indicated:

   Table 56 — Pointer modifications

   Template	Comments
   …
   template <class T> struct add_pointer;	If T names a referenceable type or a (possibly cv-qualified) void type then Tthe member typedef type shall name the same type as remove_reference_t<T>*; otherwise, type shall name T.