Blog (mostly math)

Dual Cones

Ref: “Convex Optimization” by Boyd, Vandenberghe. “Convex Optimization” by Boyd. Lecture-2. Link to lecture: Lecture. [Dual cones] Note that cones induce inequalities. Link to Stackexchange post: Link. Consider ${ \mathbb{R} ^n . }$ Let ${ K \subseteq \mathbb{R} ^n }$ be a cone. Consider the dual space \[{ (\mathbb{R} ^n)^{\ast} := \l... Read more

Hypothesis Testing

Updated: 21/10/25 Ref: “Introduction to Mathematical Statistics” by Hogg, McKean, Craig. “Statistics for Mathematicians” by Panaretos. [Hypothesis Testing] Consider a random variable ${ X }$ with density ${ f(x; \theta) , }$ ${ \theta \in \Omega . }$ Suppose we think ${ \theta \in \Omega _0 }$ or ${ \theta \in \Omega _1 , }$ where ${ \... Read more

Gaussian Errors

Consider the plane ${ \mathbb{R} ^2 . }$ Consider the origin ${ (0, 0) . }$ Consider the natural error generating process: The random error vector is ${ \mathcal{E} = (\varepsilon _1, \varepsilon _2) . }$ The components ${ \varepsilon _1, \varepsilon _2 }$ are independent and identically distributed. The distribution of ${ \mathcal{E} }$... Read more

Kernel Density Estimators

Ref: “Data Analysis for Social Scientists” by Duflo, Ellison. Lec-5. Link to the lecture: Link. Scikit-learn’s Density estimation documentation. Link to the page: Link. “Introduction to Mathematical Statistics” by Hogg, McKean, Craig. “Introduction to Nonparametric Estimation” by Tsybakov. “Smoothing methods in Statistics” by Simonoff... Read more

Entropy Power Inequality

Ref: “On the similarity of the Entropy Power Inequality and the Brunn Minkowski inequality” by Costa, Cover. “The Convolution Inequality for Entropy Powers” by Blachman. “Simple Proof of the Concavity of the Entropy Power with respect to added Gaussian Noise” by Dembo. “Stochastic Models, Information Theory, and Lie Groups, Vol 1” by Ch... Read more