Deeplearning Note

DeepLearning Note

DeepLearning note

SoA

• 2017.06.12. Attention Is All You Need: https://arxiv.org/abs/1706.03762
• 2019.02.14. GPT-2, Better Language Models and Their Implications: https://openai.com/blog/better-language-models
• 2020.06.11. GPT-3, OpenAI API: https://openai.com/blog/openai-api
• 2021.01.05. DALL·E: Creating Images from Text: https://openai.com/blog/dall-e
• 2021.06.29. Introducing GitHub Copilot: your AI pair programmer: link
• 2021.08.10. OpenAI Codex: https://openai.com/blog/openai-codex
• 2021.10.29. Solving Math Word Problems: https://openai.com/blog/grade-school-math
• 2021.12.31. A Neural Network Solves and Generates Mathematics Problems by Program Synthesis: https://arxiv.org/abs/2112.15594
• 2022.02.02. Solving (Some) Formal Math Olympiad Problems: https://openai.com/blog/formal-math
• 2022.02.02. Competitive programming with AlphaCode:https://deepmind.com/blog/article/Competitive-programming-with-AlphaCode?fbclid=IwAR1E9sSTt3XiEXn70d2YO8bx8ruBNKArzLhJ8WuZwpclXCK58qihhzgjeVE

AI for Time Series

GNN

[Tensorflow GNN v1.0] Google 에서 몇년 전부터 개발해오던 Tensorflow GNN 의 v1.0 이 몇일전에 릴리즈되었습니다. GPU 및 TPU에서 작동하며, Tutorial 을 위한 colab 또한 제공됩니다.

https://github.com/tensorflow/gnn https://pypi.org/project/tensorflow-gnn/

Main Recent Update Note

• [Jul. 05, 2023] Add papers accepted by KDD'23!
• [Jun. 20, 2023] Add papers accepted by ICML'23!
• [Feb. 07, 2023] Add papers accepted by ICLR'23 and AAAI'23!
• [Sep. 18, 2022] Add papers accepted by NeurIPS'22!
• [Jul. 14, 2022] Add papers accepted by KDD'22!
• [Jun. 02, 2022] Add papers accepted by ICML'22, ICLR'22, AAAI'22, IJCAI'22!

Table of Contents

• [Tutorials and Surveys](#Tutorials-and-Surveys)

  • Tutorials
  • Surveys

• [AI4TS Papers 2023](#AI4TS-Papers-2023)

  • NeurIPS 2023, [ICML 2023](#ICM