Center-dot notation in functions
Some papers will use a center dot (or interpunct) to represent that any value can be inserted as the value of a function.
For example, means the same as
See Mathematics StackExchange for more information.
Gradient
The symbol when seen in front of a vector-valued function like refers to the function’s gradient.
Hadamard Product
This circle-dot symbol can mean a few different things, depending on context. Typically in machine learning literature, it refers to the Hadamard product (component-wise multiplication for matrices).
Sigma
The symbol is often used to represent the standard deviation of a probability distribution.
When used as a function that takes in a value, e.g. , then it refers to the logistic sigmoid function.
Wikipedia has a more complete list of the symbol’s uses
XOR, exclusive-or, exclusive disjunction
The XOR operator is a logical operator that takes two terms. It returns true when both inputs differ.
For example, is only true when is true and is false, or when is false and when is true.
Put another way, will be false when both and are false, or when both and are true. See Exclusive or on Wikipedia for more information.
, bracket operator, max operator
The bracket operator where an expression is surrounded by a plus sign and a subscript is equivalent to . See 8 for more information.