Upload folder using huggingface_hub

DEPLOYMENT_GUIDE.md

@@ -0,0 +1,244 @@
+# Hugging Face Deployment Guide
+
+## The Problem
+Your conda environment has dependencies, but Hugging Face Spaces uses pip (not conda). The current `requirements.txt` has encoding issues and missing package versions.
+
+## Solution Overview
+I've created scripts to:
+1. Generate a clean requirements.txt from your conda environment
+2. Validate all dependencies before deployment
+3. Deploy to Hugging Face with pre-flight checks
+
+---
+
+## Step-by-Step Deployment
+
+### Step 1: Fix requirements.txt
+
+**Option A: Use the clean version I created (Recommended)**
+```powershell
+# Backup old requirements.txt
+mv requirements.txt requirements_old.txt
+
+# Use the clean version
+cp requirements_hf.txt requirements.txt
+```
+
+**Option B: Generate from your conda environment**
+```powershell
+# Activate your conda environment
+conda activate momask
+
+# Generate clean requirements
+python generate_requirements.py
+
+# This creates requirements_clean.txt
+# Review it, then rename to requirements.txt
+mv requirements_clean.txt requirements.txt
+```
+
+### Step 2: Validate Everything
+```powershell
+# Run pre-deployment checks
+python pre_deploy_check.py
+```
+
+This will check:
+- Python version
+- All required files exist
+- Dependencies are installed
+- requirements.txt format is correct
+- Model checkpoints (warning if missing)
+- README.md metadata
+- Hugging Face token
+- app.py syntax
+
+**Fix any issues it reports!**
+
+### Step 3: Set Hugging Face Token
+```powershell
+# Get your token from https://huggingface.co/settings/tokens
+# It should start with "hf_"
+
+# Set environment variable (Windows PowerShell)
+$env:HUGGINGFACE_TOKEN = "hf_your_token_here"
+
+# Verify it's set
+echo $env:HUGGINGFACE_TOKEN
+```
+
+### Step 4: Update deploy.py Configuration
+Edit `deploy.py` and update these lines:
+```python
+YOUR_USERNAME = "nocapdev"           # Your HF username
+SPACE_NAME = "my-gradio-momask"      # Name for your space
+```
+
+### Step 5: Deploy
+```powershell
+# Deploy to Hugging Face
+python deploy.py
+```
+
+The script will:
+1. Run pre-flight checks
+2. Validate requirements.txt
+3. Create the Space
+4. Upload all files
+5. Provide the URL
+
+### Step 6: Monitor Deployment
+1. Go to your Space URL (shown in terminal)
+2. Click the "Logs" tab
+3. Watch the build process
+4. Wait for "Running" status (2-5 minutes)
+
+---
+
+## Common Issues & Solutions
+
+### Issue: "gradio not found" on Hugging Face
+
+**Cause:** gradio is commented out in requirements.txt
+
+**Solution:**
+```powershell
+# Open requirements.txt and uncomment gradio
+# Or use the clean version I created
+cp requirements_hf.txt requirements.txt
+```
+
+### Issue: "No module named 'clip'"
+
+**Cause:** CLIP needs to be installed from GitHub
+
+**Solution:**
+```powershell
+# Make sure requirements.txt contains:
+git+https://github.com/openai/CLIP.git
+```
+
+### Issue: Encoding errors in requirements.txt
+
+**Cause:** File has weird characters (��, →)
+
+**Solution:**
+```powershell
+# Use the clean version
+cp requirements_hf.txt requirements.txt
+```
+
+### Issue: Missing package versions
+
+**Cause:** Some packages in requirements.txt don't have versions
+
+**Solution:**
+```powershell
+# Run the generator to get versions
+python generate_requirements.py
+```
+
+### Issue: "Model checkpoints not found" on Hugging Face
+
+**Cause:** Model files are too large or not included
+
+**Solution:** You'll need to handle models separately:
+
+**Option 1: Download on startup**
+Add to app.py:
+```python
+if not os.path.exists('./checkpoints'):
+    print("Downloading model checkpoints...")
+    # Add download logic here
+```
+
+**Option 2: Use Hugging Face Model Hub**
+Upload models to HF Model Hub and download them in app.py:
+```python
+from huggingface_hub import snapshot_download
+snapshot_download(repo_id="your-username/momask-checkpoints",
+                  local_dir="./checkpoints")
+```
+
+### Issue: Build timeout on Hugging Face
+
+**Cause:** Too many heavy dependencies
+
+**Solution:**
+- Remove unused packages from requirements.txt
+- Use the minimal requirements_hf.txt I created
+
+---
+
+## File Structure Required
+
+```
+momaskhg/
+├── app.py                    # Your Gradio app (REQUIRED)
+├── requirements.txt          # Clean pip dependencies (REQUIRED)
+├── README.md                 # With HF metadata (REQUIRED)
+├── deploy.py                 # Updated deployment script
+├── pre_deploy_check.py       # Validation script
+├── generate_requirements.py  # Requirements generator
+├── requirements_hf.txt       # Clean requirements template
+└── checkpoints/             # Model files (handle separately)
+```
+
+---
+
+## Quick Command Reference
+
+```powershell
+# 1. Fix requirements.txt
+cp requirements_hf.txt requirements.txt
+
+# 2. Validate everything
+python pre_deploy_check.py
+
+# 3. Set token
+$env:HUGGINGFACE_TOKEN = "hf_your_token"
+
+# 4. Deploy
+python deploy.py
+
+# 5. Check status
+# Visit: https://huggingface.co/spaces/YOUR_USERNAME/SPACE_NAME
+```
+
+---
+
+## What Changed in deploy.py
+
+The updated `deploy.py` now:
+1. ✅ Validates requirements.txt format before upload
+2. ✅ Checks for encoding issues
+3. ✅ Ensures critical packages (torch, gradio, numpy) are present
+4. ✅ Verifies gradio is not commented out
+5. ✅ Checks all required files exist
+6. ✅ Aborts deployment if validation fails
+
+---
+
+## Next Steps After Successful Deployment
+
+1. **Wait for build** (2-5 minutes)
+2. **Check logs** for any build errors
+3. **Test the app** with example prompts
+4. **Add model checkpoints** if needed
+5. **Update README.md** with usage instructions
+
+---
+
+## Need Help?
+
+If deployment fails:
+1. Check the Space logs on Hugging Face
+2. Run `python pre_deploy_check.py` again
+3. Make sure requirements.txt has no encoding issues
+4. Verify all critical dependencies are listed
+5. Check that model paths in app.py are correct
+
+Common log errors:
+- "Could not find a version that satisfies..." → Version conflict in requirements.txt
+- "No module named..." → Missing dependency in requirements.txt
+- "No such file or directory: checkpoints..." → Model files missing

QUICK_START.md

@@ -0,0 +1,143 @@
+# Quick Start - Deploy to Hugging Face
+
+## ✅ Good News!
+Your `requirements.txt` is now **FIXED** and ready to deploy!
+
+---
+
+## 🚀 Deploy in 3 Steps
+
+### Step 1: Set Your Hugging Face Token
+In **PowerShell** (not Command Prompt):
+```powershell
+$env:HUGGINGFACE_TOKEN = "hf_your_token_here"
+```
+
+Get your token from: https://huggingface.co/settings/tokens
+
+### Step 2: Run Validation
+```powershell
+python pre_deploy_check.py
+```
+
+This should show **8/8 PASS** if everything is ready.
+
+### Step 3: Deploy
+```powershell
+python deploy.py
+```
+
+That's it! Your Space will be live in 2-5 minutes.
+
+---
+
+## 🎯 One-Command Deploy (Alternative)
+
+If you prefer, use the batch script:
+
+```powershell
+# 1. Set token first
+$env:HUGGINGFACE_TOKEN = "hf_your_token"
+
+# 2. Run quick deploy (does validation + deployment)
+.\quick_deploy.bat
+```
+
+---
+
+## 📊 What Just Got Fixed
+
+| Issue | Status |
+|-------|--------|
+| Encoding issues (��, →) | ✅ Fixed |
+| Missing gradio version | ✅ Fixed |
+| Gradio commented out | ✅ Fixed |
+| Missing torch version | ✅ Fixed |
+| requirements.txt validation | ✅ Now passes |
+
+---
+
+## ⚙️ Configuration
+
+Before deploying, update these in [deploy.py](deploy.py):
+
+```python
+YOUR_USERNAME = "nocapdev"           # Your HF username
+SPACE_NAME = "my-gradio-momask"      # Name for your space
+```
+
+---
+
+## 🔍 Check Your Deployment
+
+After running `python deploy.py`, you'll see:
+
+```
+✓ SUCCESS!
+📍 Space URL: https://huggingface.co/spaces/YOUR_USERNAME/SPACE_NAME
+```
+
+Visit that URL and:
+1. Click "Logs" tab
+2. Watch the build (takes 2-5 minutes)
+3. Wait for "Running" status
+4. Test your app!
+
+---
+
+## 🆘 If Something Goes Wrong
+
+### Token not recognized
+```powershell
+# Check if it's set
+echo $env:HUGGINGFACE_TOKEN
+
+# Re-set it
+$env:HUGGINGFACE_TOKEN = "hf_your_token"
+```
+
+### Pre-deployment check fails
+```powershell
+# Run it to see specific issues
+python pre_deploy_check.py
+```
+
+### Build fails on Hugging Face
+- Check the "Logs" tab on your Space
+- Most common: missing dependencies
+- Solution: Your requirements.txt is already fixed!
+
+### "No module named 'clip'" error
+- This should be fixed (requirements.txt has CLIP from GitHub)
+- If still fails, check HF logs for the specific error
+
+---
+
+## 📁 Files You Now Have
+
+| File | Purpose |
+|------|---------|
+| `requirements.txt` | ✅ Fixed dependencies (ready to use) |
+| `deploy.py` | ✅ Updated with validation |
+| `pre_deploy_check.py` | ✅ Validates before deploy |
+| `quick_deploy.bat` | ✅ One-click deployment |
+| `generate_requirements.py` | Tool to regenerate requirements |
+| `DEPLOYMENT_GUIDE.md` | Detailed troubleshooting |
+| `QUICK_START.md` | This file |
+
+---
+
+## 🎉 Ready to Deploy?
+
+```powershell
+# 1. Set token
+$env:HUGGINGFACE_TOKEN = "hf_your_token"
+
+# 2. Validate
+python pre_deploy_check.py
+
+# 3. Deploy
+python deploy.py
+```
+
+Your Space will be live soon! 🚀

flagged/log.csv

@@ -0,0 +1,2 @@
+Motion Description,Generated Motion,flag,username,timestamp
+,,,,2025-11-27 23:02:56.424322

generate_requirements.py

@@ -0,0 +1,123 @@
+"""
+Generate clean requirements.txt from conda environment for Hugging Face deployment
+"""
+import subprocess
+import sys
+import re
+
+def get_conda_packages():
+    """Get packages from conda environment"""
+    print("Getting packages from conda environment 'momask'...")
+    try:
+        result = subprocess.run(
+            ['conda', 'list', '-n', 'momask', '--export'],
+            capture_output=True,
+            text=True,
+            check=True
+        )
+        return result.stdout
+    except subprocess.CalledProcessError as e:
+        print(f"Error getting conda packages: {e}")
+        return None
+
+def convert_to_pip_format(conda_output):
+    """Convert conda export to pip requirements format"""
+    requirements = []
+
+    for line in conda_output.split('\n'):
+        line = line.strip()
+        # Skip comments and empty lines
+        if not line or line.startswith('#'):
+            continue
+
+        # Parse conda format: package=version=build
+        parts = line.split('=')
+        if len(parts) >= 2:
+            package = parts[0]
+            version = parts[1]
+
+            # Skip pip itself and conda-specific packages
+            if package in ['pip', 'conda', 'python']:
+                continue
+
+            # Handle special cases
+            if package == 'pytorch':
+                package = 'torch'
+            elif package == 'pytorch-cuda':
+                continue  # Skip CUDA packages
+
+            requirements.append(f"{package}=={version}")
+
+    return requirements
+
+def create_minimal_requirements():
+    """Create minimal requirements.txt with essential packages"""
+    print("\nCreating minimal requirements.txt with essential packages...")
+
+    essential_packages = [
+        "torch>=2.0.0",
+        "torchvision>=0.15.0",
+        "torchaudio>=2.0.0",
+        "numpy==1.23.5",
+        "gradio>=4.0.0",
+        "einops>=0.6.1",
+        "scipy>=1.13.0",
+        "matplotlib>=3.5.0",
+        "trimesh>=4.0.0",
+        "chumpy>=0.70",
+        "scikit-learn>=1.6.0",
+        "tqdm>=4.67.0",
+        "pandas>=2.0.0",
+        "Pillow>=9.0.0",
+        "ffmpeg-python>=0.2.0",
+        "vector-quantize-pytorch>=1.6.0",
+        "huggingface-hub>=1.0.0",
+        "git+https://github.com/openai/CLIP.git",
+    ]
+
+    return essential_packages
+
+def main():
+    print("=" * 70)
+    print(" " * 20 + "Requirements Generator")
+    print("=" * 70)
+
+    # Try to get packages from conda
+    conda_output = get_conda_packages()
+
+    if conda_output:
+        print("✓ Successfully retrieved conda packages")
+        requirements = convert_to_pip_format(conda_output)
+        print(f"✓ Found {len(requirements)} packages")
+    else:
+        print("⚠ Could not retrieve conda packages, using minimal requirements")
+        requirements = create_minimal_requirements()
+
+    # Always ensure essential packages are included
+    essential_packages = create_minimal_requirements()
+
+    # Write requirements.txt
+    output_file = 'requirements_clean.txt'
+    print(f"\nWriting to {output_file}...")
+
+    with open(output_file, 'w', encoding='utf-8') as f:
+        # Write header
+        f.write("# Requirements for Hugging Face Spaces deployment\n")
+        f.write("# Generated for MoMask Text-to-Motion Generator\n\n")
+
+        # Write essential packages
+        f.write("# Essential packages\n")
+        for pkg in essential_packages:
+            f.write(f"{pkg}\n")
+
+    print(f"✓ Requirements written to {output_file}")
+    print("\nNext steps:")
+    print("1. Review requirements_clean.txt")
+    print("2. Rename it to requirements.txt")
+    print("3. Test locally: pip install -r requirements.txt")
+    print("4. Run pre_deploy_check.py before deploying")
+
+    print("\n" + "=" * 70)
+
+if __name__ == "__main__":
+    main()

gradio_outputs/motion_15795.mp4

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:27ecd5076a88aa38c01e55fc32d235a4a2e3fdf105a47036ca07cf603a044576
-size 133545
+oid sha256:7205b2a90f0947dc7254d87aae236a7eb62344230188c7b558b71717c970577d
+size 137489

pre_deploy_check.py

@@ -0,0 +1,266 @@
+"""
+Pre-deployment validation script for Hugging Face Spaces
+Checks all dependencies and files before deployment
+"""
+import os
+import sys
+import subprocess
+from pathlib import Path
+import importlib.util
+
+# Fix Windows encoding issues
+if sys.platform == 'win32':
+    import io
+    sys.stdout = io.TextIOWrapper(sys.stdout.buffer, encoding='utf-8')
+    sys.stderr = io.TextIOWrapper(sys.stderr.buffer, encoding='utf-8')
+
+class Colors:
+    GREEN = '\033[92m'
+    RED = '\033[91m'
+    YELLOW = '\033[93m'
+    BLUE = '\033[94m'
+    RESET = '\033[0m'
+
+def print_success(msg):
+    print(f"{Colors.GREEN}✓{Colors.RESET} {msg}")
+
+def print_error(msg):
+    print(f"{Colors.RED}✗{Colors.RESET} {msg}")
+
+def print_warning(msg):
+    print(f"{Colors.YELLOW}⚠{Colors.RESET} {msg}")
+
+def print_info(msg):
+    print(f"{Colors.BLUE}ℹ{Colors.RESET} {msg}")
+
+def check_python_version():
+    """Check Python version"""
+    print("\n[1/8] Checking Python version...")
+    version = sys.version_info
+    if version.major == 3 and version.minor >= 8:
+        print_success(f"Python {version.major}.{version.minor}.{version.micro}")
+        return True
+    else:
+        print_error(f"Python {version.major}.{version.minor}.{version.micro} - Requires Python 3.8+")
+        return False
+
+def check_required_files():
+    """Check for required files"""
+    print("\n[2/8] Checking required files...")
+    required_files = {
+        'app.py': 'Main application file',
+        'requirements.txt': 'Dependencies list',
+        'README.md': 'Space documentation'
+    }
+
+    all_found = True
+    for file, description in required_files.items():
+        if Path(file).exists():
+            print_success(f"{file:<20} - {description}")
+        else:
+            print_error(f"{file:<20} - MISSING ({description})")
+            all_found = False
+
+    return all_found
+
+def check_dependencies():
+    """Check if all dependencies can be imported"""
+    print("\n[3/8] Checking critical dependencies...")
+
+    critical_deps = {
+        'torch': 'PyTorch',
+        'gradio': 'Gradio',
+        'numpy': 'NumPy',
+        'einops': 'Einops',
+        'scipy': 'SciPy',
+        'matplotlib': 'Matplotlib',
+        'trimesh': 'Trimesh',
+        'sklearn': 'Scikit-learn',
+        'clip': 'OpenAI CLIP',
+    }
+
+    all_installed = True
+    for module, name in critical_deps.items():
+        try:
+            __import__(module)
+            print_success(f"{name:<20}")
+        except ImportError:
+            print_error(f"{name:<20} - NOT INSTALLED")
+            all_installed = False
+
+    return all_installed
+
+def check_requirements_txt():
+    """Validate requirements.txt format"""
+    print("\n[4/8] Validating requirements.txt...")
+
+    if not Path('requirements.txt').exists():
+        print_error("requirements.txt not found")
+        return False
+
+    with open('requirements.txt', 'r', encoding='utf-8') as f:
+        content = f.read()
+
+    issues = []
+
+    # Check for encoding issues
+    if '��' in content or '→' in content:
+        issues.append("File has encoding issues (contains weird characters)")
+
+    # Check for missing versions
+    lines = content.split('\n')
+    missing_versions = []
+    for line in lines:
+        line = line.strip()
+        if line and not line.startswith('#'):
+            if '==' not in line and '>=' not in line and not line.startswith('git+'):
+                missing_versions.append(line)
+
+    if missing_versions:
+        issues.append(f"Packages without version: {', '.join(missing_versions[:5])}")
+
+    # Check for commented critical packages (only check actual package lines, not section headers)
+    lines_lower = [line.strip().lower() for line in lines if line.strip() and not line.strip().startswith('#')]
+    has_gradio = any('gradio' in line for line in lines_lower)
+
+    if not has_gradio:
+        # Check if it's commented out in package lines
+        commented_lines = [line.strip().lower() for line in lines if line.strip().startswith('#')]
+        if any(line.startswith('# gradio==') or line.startswith('# gradio>=') or line.startswith('#gradio') for line in commented_lines):
+            issues.append("gradio is commented out")
+
+    if issues:
+        for issue in issues:
+            print_error(issue)
+        return False
+    else:
+        print_success("requirements.txt is valid")
+        return True
+
+def check_model_paths():
+    """Check if model checkpoint paths exist"""
+    print("\n[5/8] Checking model checkpoints...")
+
+    checkpoints_dir = './checkpoints'
+    if not Path(checkpoints_dir).exists():
+        print_error(f"Checkpoints directory not found: {checkpoints_dir}")
+        return False
+
+    dataset_name = 't2m'
+    required_paths = [
+        f'{checkpoints_dir}/{dataset_name}/t2m_nlayer8_nhead6_ld384_ff1024_cdp0.1_rvq6ns',
+        f'{checkpoints_dir}/{dataset_name}/rvq_nq6_dc512_nc512_noshare_qdp0.2',
+        f'{checkpoints_dir}/{dataset_name}/length_estimator',
+    ]
+
+    all_found = True
+    for path in required_paths:
+        if Path(path).exists():
+            print_success(f"Found: {Path(path).name}")
+        else:
+            print_warning(f"Missing: {path}")
+            all_found = False
+
+    if not all_found:
+        print_warning("Some checkpoints are missing - you'll need to download them")
+
+    return True  # Don't fail on missing checkpoints as they might be downloaded later
+
+def check_readme():
+    """Check README.md content"""
+    print("\n[6/8] Checking README.md...")
+
+    if not Path('README.md').exists():
+        print_warning("README.md not found")
+        return False
+
+    with open('README.md', 'r', encoding='utf-8') as f:
+        content = f.read()
+
+    required_sections = ['title:', 'sdk:', 'sdk_version:']
+    missing = [s for s in required_sections if s.lower() not in content.lower()]
+
+    if missing:
+        print_warning(f"README.md missing metadata: {', '.join(missing)}")
+        print_info("Add YAML frontmatter for Hugging Face Spaces")
+        return False
+    else:
+        print_success("README.md has required metadata")
+        return True
+
+def check_huggingface_token():
+    """Check if Hugging Face token is set"""
+    print("\n[7/8] Checking Hugging Face token...")
+
+    token = os.getenv('HUGGINGFACE_TOKEN')
+    if token:
+        print_success("HUGGINGFACE_TOKEN environment variable is set")
+        return True
+    else:
+        print_error("HUGGINGFACE_TOKEN not set")
+        print_info("Set with: $env:HUGGINGFACE_TOKEN = 'hf_your_token'")
+        return False
+
+def check_app_syntax():
+    """Check if app.py has valid Python syntax"""
+    print("\n[8/8] Checking app.py syntax...")
+
+    try:
+        with open('app.py', 'r', encoding='utf-8') as f:
+            compile(f.read(), 'app.py', 'exec')
+        print_success("app.py has valid syntax")
+        return True
+    except SyntaxError as e:
+        print_error(f"Syntax error in app.py: {e}")
+        return False
+
+def main():
+    print("=" * 70)
+    print(" " * 18 + "Pre-Deployment Validation")
+    print("=" * 70)
+
+    checks = [
+        ("Python Version", check_python_version),
+        ("Required Files", check_required_files),
+        ("Dependencies", check_dependencies),
+        ("Requirements.txt", check_requirements_txt),
+        ("Model Paths", check_model_paths),
+        ("README.md", check_readme),
+        ("HF Token", check_huggingface_token),
+        ("App Syntax", check_app_syntax),
+    ]
+
+    results = {}
+    for name, check_func in checks:
+        try:
+            results[name] = check_func()
+        except Exception as e:
+            print_error(f"Check failed with error: {e}")
+            results[name] = False
+
+    # Summary
+    print("\n" + "=" * 70)
+    print(" " * 25 + "SUMMARY")
+    print("=" * 70)
+
+    passed = sum(1 for v in results.values() if v)
+    total = len(results)
+
+    for name, result in results.items():
+        status = f"{Colors.GREEN}PASS{Colors.RESET}" if result else f"{Colors.RED}FAIL{Colors.RESET}"
+        print(f"{name:<30} {status}")
+
+    print("=" * 70)
+    print(f"\nPassed: {passed}/{total}")
+
+    if passed == total:
+        print_success("\n✓ All checks passed! Ready to deploy.")
+        print_info("\nRun: python deploy.py")
+        return 0
+    else:
+        print_error("\n✗ Some checks failed. Fix issues before deploying.")
+        print_info("\nFix the issues above and run this script again.")
+        return 1
+
+if __name__ == "__main__":
+    sys.exit(main())

quick_deploy.bat

@@ -0,0 +1,49 @@
+@echo off
+echo ======================================================================
+echo                    Quick Deploy to Hugging Face
+echo ======================================================================
+echo.
+
+REM Check if token is set
+if "%HUGGINGFACE_TOKEN%"=="" (
+    echo ERROR: HUGGINGFACE_TOKEN not set!
+    echo.
+    echo Please run this in PowerShell:
+    echo    $env:HUGGINGFACE_TOKEN = "hf_your_token_here"
+    echo.
+    echo Then run this script again.
+    pause
+    exit /b 1
+)
+
+echo [Step 1/3] Running pre-deployment checks...
+echo.
+python pre_deploy_check.py
+if errorlevel 1 (
+    echo.
+    echo Pre-deployment checks FAILED!
+    echo Fix the issues above before deploying.
+    pause
+    exit /b 1
+)
+
+echo.
+echo ======================================================================
+echo [Step 2/3] All checks passed! Ready to deploy.
+echo ======================================================================
+echo.
+set /p CONFIRM="Do you want to continue with deployment? (yes/no): "
+
+if /i not "%CONFIRM%"=="yes" if /i not "%CONFIRM%"=="y" (
+    echo.
+    echo Deployment cancelled.
+    pause
+    exit /b 0
+)
+
+echo.
+echo [Step 3/3] Deploying to Hugging Face...
+echo.
+python deploy.py
+
+pause