Skip to content

Chapter 11: Writing Research Papers

🎓 Learning Objectives

  • Understand paper structure and sections
  • Learn effective writing techniques
  • Master LaTeX for academic writing
  • Learn to create figures and tables
  • Understand citation and bibliography

Paper Structure

Most ML papers follow this standard structure:

  1. Title & Abstract
  2. Introduction
  3. Related Work
  4. Methodology
  5. Experiments
  6. Results & Discussion
  7. Conclusion
  8. References

Structure Importance

Following standard structure helps readers and reviewers. Deviate only with good reason.

Title and Abstract

Title

Characteristics: - Concise: 10-15 words - Descriptive: Clear about content - Specific: Not too broad - Keywords: Include important terms

Examples: - ❌ Bad: "A New Machine Learning Method" - ✅ Good: "Attention Is All You Need" - ✅ Good: "BERT: Pre-training of Deep Bidirectional Transformers"

Title Tips

  • Include key method/contribution
  • Use active voice
  • Avoid unnecessary words
  • Make it searchable

Abstract

Purpose: Summary of entire paper (150-250 words)

Structure: 1. Problem: What problem? 2. Method: How do you solve it? 3. Results: What did you achieve? 4. Impact: Why does it matter?

Abstract Importance

Most people only read abstract. Make it compelling and complete.

Abstract Template: 

[Problem statement]. [Existing limitations]. 
We propose [method] that [key idea]. 
Our approach [how it works]. 
Experiments on [datasets] show [results]. 
[Main contribution/impact].

Introduction

Purpose

Goals: - Motivate the problem - Provide context - State contributions - Outline paper structure

Structure

1. Opening (1-2 paragraphs): - Broad context - Problem importance - Motivation

2. Problem Statement (1 paragraph): - Specific problem - Why it matters - Current limitations

3. Contributions (1 paragraph): - What you do - Key innovations - Main results

4. Paper Organization (1 paragraph): - Section overview - Roadmap

Introduction Tips

  • Start broad, narrow down
  • Clearly state contributions
  • Motivate why it matters
  • Be specific

Purpose

Goals: - Survey existing work - Position your work - Identify gaps - Show knowledge

Organization

Options: - Chronological: Evolution of field - Thematic: By approach/method - By component: Different aspects

Related Work

  • Be comprehensive but focused
  • Compare fairly
  • Identify gaps clearly
  • Position your work

Writing Tips

Do: - Fair comparisons - Acknowledge strengths - Identify limitations - Show your contribution

Don't: - Dismiss other work - Cherry pick comparisons - Ignore relevant work - Be overly critical

Methodology

Purpose

Goals: - Describe your method - Provide enough detail - Enable reproduction - Justify design choices

Structure

1. Overview: - High-level approach - Key ideas - Architecture

2. Details: - Algorithm description - Mathematical formulation - Implementation details - Design choices

3. Justification: - Why this approach? - Design rationale - Trade-offs

Detail Level

  • Enough detail to reproduce
  • Not too much implementation detail
  • Balance clarity and completeness
  • Use supplementary for extra details

Mathematical Notation

Best Practices: - Consistent: Same notation throughout - Clear: Define all symbols - Standard: Use common conventions - Readable: Not too complex

Notation

Define notation in first use or notation section. Be consistent.

Experiments

Purpose

Goals: - Validate method - Compare with baselines - Show improvements - Analyze behavior

Structure

1. Experimental Setup: - Datasets - Baselines - Metrics - Implementation details

2. Main Results: - Performance comparison - Key findings - Statistical significance

3. Ablation Studies: - Component analysis - Design choices - Hyperparameter sensitivity

4. Analysis: - Why it works - Failure cases - Limitations

Experiments Section

  • Fair comparisons
  • Multiple datasets
  • Statistical significance
  • Ablation studies
  • Honest about limitations

Results and Discussion

Results Presentation

Tables: - Clear formatting - Significant digits - Statistical measures - Comparisons

Figures: - High quality - Clear labels - Informative - Professional

Visualization

  • Use consistent style
  • Clear labels and legends
  • High resolution
  • Color-blind friendly

Discussion

Include: - Interpretation of results - Why method works - Failure cases - Limitations - Future work

Limitations

Always discuss limitations. Shows honesty and helps future work.

Writing Style

Clarity

Principles: - Simple: Use simple words - Clear: One idea per sentence - Concise: Remove unnecessary words - Active: Prefer active voice

Writing Tips

  • Write clearly
  • Use active voice
  • Be concise
  • Proofread carefully

Common Mistakes

Avoid These

  • Verbose: Too many words
  • Vague: Unclear statements
  • Jargon: Unnecessary technical terms
  • Passive: Overuse of passive voice
  • Typos: Spelling/grammar errors

LaTeX for Academic Writing

Why LaTeX?

Advantages: - Professional typesetting - Math support - Bibliography management - Version control friendly - Standard in academia

LaTeX

Essential for academic writing. Learn it.

Basic Structure

\documentclass{article}
\usepackage{...}

\title{Your Title}
\author{Your Name}
\date{\today}

\begin{document}
\maketitle

\section{Introduction}
Content here.

\section{Methodology}
Content here.

\bibliography{references}
\end{document}

Common Packages

Essential: - amsmath: Math - graphicx: Figures - algorithm: Algorithms - algorithmic: Algorithm pseudocode - natbib or biblatex: Bibliography

LaTeX Resources

  • Overleaf (online editor)
  • LaTeX tutorials
  • Template repositories
  • Stack Overflow

Figures and Tables

Figures

Best Practices: - High resolution (300+ DPI) - Clear labels - Consistent style - Informative captions - Vector format when possible

Tools: - Python (matplotlib, seaborn) - TikZ (LaTeX) - Inkscape/Illustrator - Plotly

Figure Quality

Poor figures hurt paper quality. Invest time in good figures.

Tables

Best Practices: - Clear structure - Consistent formatting - Significant digits - Statistical measures - Professional appearance

LaTeX Tables: 

\begin{table}[h]
\centering
\begin{tabular}{lcc}
\hline
Method & Accuracy & F1 \\
\hline
Baseline & 0.85 & 0.82 \\
Ours & 0.92 & 0.90 \\
\hline
\end{tabular}
\caption{Results comparison}
\end{table}

Citations and Bibliography

Citation Styles

Common Styles: - NeurIPS/ICML: Author-year - IEEE: Numbered - ACM: Author-year - APA: Author-year

Citation Style

Check conference/journal requirements. Use consistent style.

Bibliography Management

Tools: - BibTeX: LaTeX bibliography - BibLaTeX: Modern alternative - Zotero/Mendeley: Reference managers

BibTeX Entry: 

@article{author2024title,
  title={Title},
  author={Author, A.},
  journal={Journal},
  year={2024}
}

Bibliography

Use reference managers. Saves time and reduces errors.

Resources

📚 Writing Guides
  1. How to Write a Research Paper - Elsevier guide
  2. Scientific Writing - Nature guide
  3. LaTeX Guide - LaTeX tutorial
🛠️ Tools
  1. Overleaf - Online LaTeX editor
  2. Zotero - Reference management
  3. Grammarly - Writing assistant
  4. Draw.io - Diagrams
📝 Templates
  1. NeurIPS Template - NeurIPS
  2. ICML Template - ICML
  3. arXiv Template - arXiv style

Next Steps

Key Takeaways: - Follow standard paper structure - Write clearly and concisely - Use LaTeX for typesetting - Create high-quality figures - Cite properly - Proofread carefully - Get feedback before submission