TCS+

A carbon-free dissemination of ideas across the globe.

TCS+ talk: Wednesday, October 9 — Renato Ferreira Pinto Jr, U Waterloo

The next TCS+ talk will take place this coming Wednesday, October 9th at 1:00 PM Eastern Time (10:00 AM Pacific Time, 19:00 Central European Time, 17:00 UTC). Renato Ferreira Pinto Jr from U Waterloo will speak about “”Directed Isoperimetry and Monotonicity Testing: A Dynamical Approach“” (abstract below).

You can reserve a spot as an individual or a group to join us live by signing up on the online form. Registration is not required to attend the interactive talk, and the link will be posted on the website the day prior to the talk; however, by registering in the form, you will receive a reminder, along with the link. (The recorded talk will also be posted on our website afterwards) As usual, for more information about the TCS+ online seminar series and the upcoming talks, or to suggest a possible topic or speaker, please see the website.

Abstract: This work explores the connection between classical isoperimetric inequalities, their directed analogues, and monotonicity testing. We study the setting of real-valued functions f : [0,1]^d \to \mathbb{R} on the solid unit cube, where the goal is to test with respect to the L^p distance. Our goals are twofold: to further understand the relationship between classical and directed isoperimetry, and to give a monotonicity tester with sublinear query complexity in this setting.

Our main results are 1) an L^2 monotonicity tester for M-Lipschitz functions with query complexity \widetilde O(\sqrt{d} M^2 / \epsilon^2) and, behind this result, 2) the directed Poincaré inequality \mathsf{dist}^{\mathsf{mono}}_2(f)^2 \le C \mathbb{E}[|\nabla^- f|^2], where the “”directed gradient”” operator \nabla^- measures the local violations of monotonicity of f.

To prove the second result, we introduce a partial differential equation (PDE), the directed heat equation, which takes a one-dimensional function f into a monotone function f^* over time and enjoys many desirable analytic properties. We obtain the directed Poincaré inequality by combining convergence aspects of this PDE with the theory of optimal transport. Crucially for our conceptual motivation, this proof is in complete analogy with the mathematical physics perspective on the classical Poincaré inequality, namely as characterizing the convergence of the standard heat equation toward equilibrium.

TCS+ talk: Wednesday, September 25 — Adam Klivans, UT Austin

The new season of TCS+ is starting! Our first TCS+ talk will take place on Wednesday, September 25th at 1:00 PM Eastern Time (10:00 AM Pacific Time, 19:00 Central European Time, 17:00 UTC). Adam Klivans from UT Austin will speak about “Efficient Algorithms for Learning with Distribution Shift ” (abstract below). Peeking ahead: you can have a look at all upcoming talks on our calendar.

You can reserve a spot as an individual or a group to join us live by signing up on the online form. Registration is not required to attend the interactive talk, and the link will be posted on the website the day prior to the talk; however, by registering in the form, you will receive a reminder, along with the link. (The recorded talk will also be posted on our website afterwards) As usual, for more information about the TCS+ online seminar series and the upcoming talks, or to suggest a possible topic or speaker, please see the website.

Abstract: We revisit the fundamental problem of learning with distribution shift, where a learner is given labeled samples from training distribution D, unlabeled samples from test distribution D′ and is asked to output a classifier with low test error. The standard approach in this setting is to prove a generalization bound in terms of some notion of distance between D and D′. These distances, however, are difficult to compute, and this has been the main stumbling block for algorithm design.

We sidestep this issue and define a new model called TDS learning, where a learner runs a test on the training set and is allowed to reject if this test detects distribution shift relative to a fixed output classifier. Moreover, when the test accepts, the output classifier is guaranteed to have low test error. We will describe how this approach leads to a rich set of efficient algorithms for learning well-studied function classes without taking any assumptions on the test distribution. Our techniques touch on a wide array of topics including pseudorandomness, property testing, and sum of squares proofs.

Joint work with Konstantinos Stavropoulos and Arsen Vasilyan.

New season of TCS+: you can suggest talks!

The next season of TCS+ is not so far away! As a team, we try to keep an eye out for interesting talks, great results, and amazing speakers: but we might miss or overlook some (many). This is why it’s important to hear from you: what papers would you like to learn about on TCS+? Which line of work would you like to be surveyed? Which speaker would you love to hear?

Please provide suggestions via this form. (Self-nominations are allowed.)

TCS+ talk: Wednesday, May 29 — Jyun-Jie Liao, Cornell University

The next TCS+ talk will take place this coming Wednesday, May 29th at 1:00 PM Eastern Time (10:00 AM Pacific Time, 19:00 Central European Time, 17:00 UTC). Jyun-Jie Liao from Cornell University will speak about “Recent Progress on Marton’s Conjecture” (abstract below).

You can reserve a spot as an individual or a group to join us live by signing up on the online form. Registration is not required to attend the interactive talk, and the link will be posted on the website the day prior to the talk; however, by registering in the form, you will receive a reminder, along with the link. (The recorded talk will also be posted on our website afterwards) As usual, for more information about the TCS+ online seminar series and the upcoming talks, or to suggest a possible topic or speaker, please see the website.

Abstract: A conjecture by Katalin Marton, widely known as the Polynomial Freiman-Ruzsa (PFR) conjecture, was recently proved by Gowers, Green, Manners and Tao for any bounded-torsion Abelian group G. In this talk we will briefly review some applications of PFR in theoretical computer science, and go through the beautiful proof by Gowers, Green, Manners and Tao. Finally we will see some technical ideas in my recent work which can further improve their bound when G=GF(2)^n.

TCS+ talk: Wednesday, May 15 — Julia Chuzhoy, TTIC

The next TCS+ talk will take place this coming Wednesday, May 15th at 1:00 PM Eastern Time (10:00 AM Pacific Time, 19:00 Central European Time, 17:00 UTC). Julia Chuzhoy from TTIC will speak about “Faster Combinatorial Algorithms for Bipartite Matching” (abstract below).

You can reserve a spot as an individual or a group to join us live by signing up on the online form. Registration is not required to attend the interactive talk, and the link will be posted on the website the day prior to the talk; however, by registering in the form, you will receive a reminder, along with the link. (The recorded talk will also be posted on our website afterwards) As usual, for more information about the TCS+ online seminar series and the upcoming talks, or to suggest a possible topic or speaker, please see the website.

Abstract: Maximum bipartite matching is among the most fundamental and well-studied problems in combinatorial optimization. A beautiful and celebrated combinatorial algorithm of Hopcroft and Karp solves the problem in time O(m \sqrt{n}) on a graph with n vertices and m edges. For the case of very dense graphs, a different algorithm based on fast matrix multiplication was subsequently developed, with running time of O(n^{2.371}). This remained the state of the art until recently, when a new method for solving maximum flow and related problems was introduced, that utilizes continuous optimization techniques, such as interior-point methods for solving linear programs. Following this, a sequence of remarkable new results that rely on this method have led to faster algorithms, culminating in a recent spectacular breakthrough, that gives an almost-linear time algorithm for maximum bipartite matching, and more generally, for min cost flow.

This raises a natural question: is it possible to obtain faster algorithms for the bipartite matching problem via combinatorial techniques? In this talk we present new results that provide a positive answer to this question, by designing faster combinatorial algorithms for the problem, via the classical augmenting-path based approach.

Joint work with Sanjeev Khanna.

Guest post: TCS for All (previously TCS Women) Spotlight Workshop at STOC 2024/Theory Fest: Travel grants and call for speaker nominations.

Guest post by the organizers of TCS for All (previously TCS Women).

You are cordially invited to our TCS for All Spotlight Workshop! The workshop will be held on June 24, 2024, at 12:30 pm – 2 pm, and 4:15 pm – 5:45 pm in Vancouver, Canada as part of the 56th Symposium on Theory of Computing (STOC) and TheoryFest! The workshop is open to all.

More information about the workshop would be made available here: https://sigact.org/tcsforall/. In particular, we would like to highlight the TCS for All Travel Scholarships (deadline April 28th) and a call for nominations for Rising Stars talks at the workshop (deadline April 28th).  More information on those are below.

Hope to see you in Vancouver!

TCS for All Travel Scholarship:

TCS for All Travel Scholarships are intended for researchers at the beginning of their career. This scholarship is being made available for minorities in TCS, and anyone who identifies as such is welcome to apply; this scholarship is open to both US and international students. Preference will be given to students at the beginning of their studies. If we have sufficient funding, we will give awards to more senior students and possibly even postdocs.

To apply, you will need to fill out the following form by April 28th, 2024 (11:59 pm PDT) in which you provide basic information about yourself, an estimate of your expenses, and a brief statement:

Apply for a travel grant here.

In addition, you will need to have your advisor (or department head or other faculty mentor if you do not yet have an advisor) send a letter of support to [email protected] by April 28th. Your advisor’s letter should also describe the availability of other travel funds.  Note for advisors: Specifics about alternative funding are very helpful.  Statements like “funding is tight” are not very helpful. This letter should be sent with the subject line “support letter for [your name]”. This is very important. Your application is not complete without this letter.

Late applications (after April 28th) will not be accepted. You will be notified about your status by May 5th, which is prior to the STOC early registration deadline and hotel cut-off deadline.

Notes: Receipts will be required for all travel awards, and reimbursements will be made after the conference. Food or visa expenses will not be reimbursed.

Nominations for Rising Star talks:

We invite nominations for speakers in our Rising Star talks at the TCS for All Spotlight Workshop at STOC 2024. To be eligible, your nominee has to be a senior PhD student with expected graduation no later than August 2024, or a postdoc in theoretical computer science (all topics represented at STOC are welcome), an underrepresented minority, and not a speaker at a previous TCS Women Spotlight Workshop.  Preference will be given to speakers who are currently on the job market for postdoctoral/faculty positions, or who expect to be on the job market in Fall 2024.

You can make your nomination by filling this form by April 28th: https://forms.gle/WAZsXRm2wuxhdukK7

TCS+ talk: Wednesday, April 10 — Zeyong Li, National University of Singapore (NUS)

The next TCS+ talk will take place this coming Wednesday, April 10th at 10:30 AM Eastern Time (7:30 AM Pacific Time, 16:30 Central Summer European Time, 14:30 UTC: check yours here). Zeyong Li from National University of Singapore (NUS) will speak about “Simple Circuit Lower Bound via Algorithm for the Range Avoidance Problem” (abstract below). Note the slightly unusual time!

You can reserve a spot as an individual or a group to join us live by signing up on the online form. Registration is not required to attend the interactive talk, and the link will be posted on the website the day prior to the talk; however, by registering in the form, you will receive a reminder, along with the link. (The recorded talk will also be posted on our website afterwards) As usual, for more information about the TCS+ online seminar series and the upcoming talks, or to suggest a possible topic or speaker, please see the website.

Abstract: We present a simple single-valued FS_2P algorithm for the Range Avoidance Problem. As a result, we obtain the circuit lower bound S_2E \not \subset i.o.-SIZE[2^n/n] and many other corollaries:

  1. Almost-everywhere near-maximum circuit lower bound for Sigma_2E \intersect Pi_2E and for ZPE^NP.
  2. Pseudodeterministic FZPP^NP constructions for: Ramsey graphs, rigid matrices, pseudorandom generators, two-source extractors, linear codes, hard truth tables, and K^poly-random strings.

This talk is based on the paper titled ‘Symmetric Exponential Time Requires Near-Maximum Circuit Size: Simplified, Truly Uniform’, to appear in STOC 2024.

TCS+ talk: Wednesday, March 20 — Huan Li, University of Pennsylvania

TCS+ is back for a new season! The next TCS+ talk will take place this coming Wednesday, March 20th at 1:00 PM Eastern Time (10:00 AM Pacific Time, 18:00 Central European Time, 17:00 UTC). Huan Li from University of Pennsylvania will speak about “Parallel Approximate Maximum Flows in Near-Linear Work and Polylogarithmic Depth” (abstract below).

You can reserve a spot as an individual or a group to join us live by signing up on the online form. Registration is not required to attend the interactive talk, and the link will be posted on the website the day prior to the talk; however, by registering in the form, you will receive a reminder, along with the link. (The recorded talk will also be posted on our website afterwards) As usual, for more information about the TCS+ online seminar series and the upcoming talks, or to suggest a possible topic or speaker, please see the website.

Abstract: We present a parallel algorithm for the (1-\epsilon)-approximate maximum flow problem in capacitated, undirected graphs with n vertices and $m$ edges, achieving O(\epsilon^{-3}\text{polylog} n) depth and O(m \epsilon^{-3} \text{polylog} n) work in the PRAM model. Although near-linear time sequential algorithms for this problem have been known for almost a decade, no parallel algorithms that simultaneously achieved polylogarithmic depth and near-linear work were known. At the heart of our result is a polylogarithmic depth, near-linear work recursive algorithm for computing congestion approximators. Our algorithm involves a recursive step to obtain a low-quality congestion approximator followed by a “boosting” step to improve its quality which prevents a multiplicative blow-up in error. Similar to Peng [SODA’16], our boosting step builds upon the hierarchical decomposition scheme of R\”acke, Shah, and T\”aubig [SODA’14]. A direct implementation of this approach, however, leads only to an algorithm with n^{o(1)} depth and m^{1+o(1)} work. To get around this, we introduce a new hierarchical decomposition scheme, in which we only need to solve maximum flows on subgraphs obtained by contracting vertices, as opposed to vertex-induced subgraphs used in R\”acke, Shah, and T\”aubig [SODA’14]. In particular, we are able to directly extract congestion approximators for the subgraphs from a congestion approximator for the entire graph, thereby avoiding additional recursion on those subgraphs. Along the way, we also develop a parallel flow-decomposition algorithm that is crucial to achieving polylogarithmic depth and may be of independent interest.

TCS+ talk: Wednesday, December 13 — Aaron Bernstein, Rutgers University

The next TCS+ talk (and the last of 2023!) will take place this coming Wednesday, December 13th at 1:00 PM Eastern Time (10:00 AM Pacific Time, 19:00 Central European Time, 18:00 UTC). Aaron Bernstein from Rutgers University will speak about “Negative-Weight Single-Source Shortest Paths in Near-linear Time” (abstract below).

You can reserve a spot as an individual or a group to join us live by signing up on the online form. Registration is not required to attend the interactive talk, and the link will be posted on the website the day prior to the talk; however, by registering in the form, you will receive a reminder, along with the link. (The recorded talk will also be posted on our website afterwards) As usual, for more information about the TCS+ online seminar series and the upcoming talks, or to suggest a possible topic or speaker, please see the website.

Abstract: We present a randomized algorithm that computes single-source shortest paths (SSSP) in O(m\log^8(n)\log W) time when edge weights are integral and can be negative. This essentially resolves the classic negative-weight SSSP problem. The previous bounds are \tilde O((m+n^{1.5})\log W) [BLNPSSSW FOCS’20] and m^{4/3+o(1)}\log W [AMV FOCS’20]. Near-linear time algorithms were known previously only for the special case of planar directed graphs [Fakcharoenphol and Rao FOCS’01].

In contrast to all recent developments that rely on sophisticated continuous optimization methods and dynamic algorithms, our algorithm is simple: it requires only a simple graph decomposition and elementary combinatorial tools. In fact, ours is the first combinatorial algorithm for negative-weight SSSP to break through the classic \tilde O(m\sqrt{n}\log W) bound from over three decades ago [Gabow and Tarjan SICOMP’89].

Paper: https://arxiv.org/abs/2203.03456

TCS+ talk: Wednesday, November 29 — Kasper Green Larsen, Aarhus University

The next TCS+ talk will take place this coming Wednesday, November 29th at 10:30 AM Eastern Time (7:30 AM Pacific Time, 16:30 Central European Time, 15:30 UTC — note the unusual time!). Kasper Green Larsen from Aarhus University will speak about “Bagging is an Optimal PAC Learner” (abstract below).

You can reserve a spot as an individual or a group to join us live by signing up on the online form. Registration is not required to attend the interactive talk, and the link will be posted on the website the day prior to the talk; however, by registering in the form, you will receive a reminder, along with the link. (The recorded talk will also be posted on our website afterwards) As usual, for more information about the TCS+ online seminar series and the upcoming talks, or to suggest a possible topic or speaker, please see the website.

Abstract: Determining the optimal sample complexity of PAC learning in the realizable setting was a central open problem in learning theory for decades. Finally, the seminal work by Hanneke (2016) gave an algorithm with a provably optimal sample complexity. His algorithm is based on a careful and structured sub-sampling of the training data and then returning a majority vote among hypotheses trained on each of the sub-samples. While being a very exciting theoretical result, it has not had much impact in practice, in part due to inefficiency, since it constructs a polynomial number of sub-samples of the training data, each of linear size. I

n this talk, we prove the surprising result that the practical and classic heuristic Bagging (a.k.a. bootstrap aggregation), due to Breiman (1996), is in fact also an optimal PAC learner. Bagging pre-dates Hanneke’s algorithm by twenty years and is taught in most undergraduate machine learning courses. Moreover, we show that it only requires a logarithmic number of sub-samples to reach optimality.

This work was published at COLT’23 and received the Best Paper Award.

Design a site like this with WordPress.com
Get started