Skip to content
Node packVerifiedExternal
Open source

ComfyUI_RyanOnTheInside

Everything-Reactivity in ComfyUI (audio, MIDI, motion, proximity, and more). Animate and manipulate images, masks, videos, audio, and more. Native ACEStep extensions

Maintainer@ryanontheinsideBgrade

Package profile

Status
Verified
Publisher
@ryanontheinside
Source
GitHub
Stars
866

README

ComfyUI RyanOnTheInside Node Pack

ryanontheinside.com | GitHub | Civitai | YouTube

🚨 Important: Version 2.0 Update 🚨

Overview

These nodes react to everything, including audio.

Everything Reactivity: Almost all nodes in this pack can be made to react to audio, MIDI, motion, time, color, depth, brightness, and more, allowing for incredibly dynamic and responsive workflows. If a node prefixed with FLEX, then this reactivity is central to its functionality.**

  • 💪 Flex Features: Dynamic control over IPAdapters, Masks, Images, Videos, Audio, and more
  • 🎵 Audio & MIDI Processing: Separate instruments, manipulate audio, work with ACEStep and other audio models
  • 🎆 Particle Systems: Create mesmerizing, fluid-like effects
  • 🌊 Optical Flow: Generate masks based on motion in videos
  • 🎨 ACE-Step 1.5 Native: Native ComfyUI guiders for ACE-Step 1.5 — extend/repaint and cover
  • 🌊 DEPTH Flow 🌊: Use flex features to control depthflow nodes, adding parallax animations to your workflows!
  • 👤 AdvancedLivePortrait 👤: Use flex features to control facial animation expressions!
  • 🎨 Advanced Controlnet 🎨: Direct integration with ComfyUI-AdvancedControlnet!
  • 🎭 AnimateDiff 🎭: Direct integration with ComfyUI-AnimateDiff-Evolved!

🚨 Important: Version 2.0 Update 🚨

If you are not getting updates, or are having trouble updating from ComfyUI-Manager, please totally uninstall the nodepack and reinstall it to restore normal update behavior.

🎉 What's New in V2

  • License: This project is now licensed under the MIT License.

  • EVERYTHING reacts to EVERYTHING: Now you can modulate ALL parameters of ALL Flex nodes! Possibilities increased by multiple orders of magnitude.

  • Optional Feature Inputs: Feature inputs are now optional! This means these nodes double as a powerful suite for image, mask, and video manipulation even without reactivity!

  • More Intuitive: Redesigned with user experience in mind. Less noodles, more intuitive connections.

  • Help: Takes full advantage of ComfyUI's tooltip system.

  • Manual Feature Creation: New interface for drawing/creating features manually - far more powerful than it might seem!

  • Text as Features: New integration with Open AI Whisper allows text to be used as a feature source, with a fully modular trigger system

  • Enhanced External Integration: Deeper compatibility with external node packs

  • Image Improvements: Major improvements to FlexImage nodes. One might say they are more than useful now.

  • Mask Improvements: Major improvements to FlexMask nodes.

  • Performance Improvements: Major performance improvements in many nodes. More to follow.

  • Feature Modulation: More robust and feature-rich modulation system.

  • And much more!

Nodes in this pack

100 nodes
  • _mfc
  • ACEStep15GenerationSteering
  • ACEStep15KeystoneConfig
  • ACEStep15LatentChannelEQ
  • ACEStep15MusicalControls
  • ACEStep15NativeCoverGuider
  • ACEStep15NativeEditGuider
  • ACEStep15NativeExtractGuider
  • ACEStep15NativeLegoGuider
  • ACEStep15SemanticExtractor
  • ACEStep15SemanticHintsBlend
  • ACEStep15SilenceLatent
  • ACEStep15TaskTextEncode
  • ACEStepAnalyzeLatent
  • ACEStepAudioPostProcessor
  • ACEStepExtendGuider
  • ACEStepHybridGuider
  • ACEStepMaskVisualizer
  • ACEStepRepaintGuider
  • ACEStepTimeRange
  • AdvancedFeatureCombiner
  • AdvancedLuminanceMask
  • AnimatedFeaturePreview
  • AnimatedFloatPreview
  • AreaFeatureNode
  • Audio_Combine
  • Audio_Concatenate
  • AudioChannelMerge
  • AudioChannelSplit
  • AudioDither
  • AudioFade
  • AudioFeatureExtractor
  • AudioFeatureVisualizer
  • AudioFilter
  • AudioGain
  • AudioInfo
  • AudioLatentBlend
  • AudioLatentInfo
  • AudioLatentStretch
  • AudioMaskAnalyzer
  • AudioPad
  • AudioPitchShift
  • AudioRegionMask
  • AudioRegionMask15
  • AudioResample
  • AudioSeparatorSimple
  • AudioSubtract
  • AudioTemporalMask
  • AudioTemporalMask15
  • AudioTimeStretch
  • AudioTrim
  • AudioVolumeNormalization
  • BeatWaveFeatureExtractor
  • BrightnessFeatureNode
  • Color_Picker
  • ColorFeatureNode
  • ContextModifier
  • DepthBlender
  • DepthFeatureNode
  • DepthInjection
  • DepthRippleEffect
  • DepthShapeModifier
  • DepthShapeModifierPrecise
  • Doom_
  • DownloadOpenUnmixModel
  • DrawableFeatureNode
  • DyeImage
  • EffectVisualizer
  • EmbeddingGuidedLatentInterpolate
  • EmitterEmissionRateModulation
  • EmitterMovement
  • EmptyImageAndMaskFromAudio
  • EmptyImageFromAudio
  • EmptyMaskFromAudio
  • FeatureAccumulate
  • FeatureCombine
  • FeatureContiguousInterpolate
  • FeatureFade
  • FeatureInfoNode
  • FeatureInterpolateMulti
  • FeatureInterpolator
  • FeatureMath
  • FeatureMixer
  • FeatureOscillator
  • FeaturePeakDetector
  • FeatureRebase
  • FeatureRenormalize
  • FeatureScaler
  • FeatureSmoothing
  • FeatureToFilteredList
  • FeatureToFlexFloatParam
  • FeatureToFlexIntParam
  • FeatureToFloat
  • FeatureToLatentKeyframe
  • FeatureToMask
  • FeatureToSplineData
  • FeatureToTimestepKeyframe
  • FeatureToWeightsStrategy
  • FeatureTruncateOrExtend
  • FlexAudioPitchShift

Related resources

3 connections

Sources

3 sources
GitHubSourceVersion 52daf666925e5c17b21704418ce30a0de3a462a2
github.com/ryanontheinside/ComfyUI_RyanOnTheInside

Verified Oct 20

Source excerpts

1 excerpt

Source context: Repo ryanontheinside/ComfyUI_RyanOnTheInside